-- Logs begin at Tue 2021-06-01 18:11:00 UTC, end at Tue 2021-06-01 19:05:16 UTC. --
Jun 01 18:39:28.319178 dv-cinder-794021-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 01 18:39:29.274867 dv-cinder-794021-1-iscsi neutron-server[98151]: Beware of the coming changes in the project packaging
Jun 01 18:39:29.275473 dv-cinder-794021-1-iscsi neutron-server[98151]: https://github.com/svinota/pyroute2/discussions/786
Jun 01 18:39:30.715813 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.common.config [-] Logging enabled!
Jun 01 18:39:30.716487 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 18:39:30.716594 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98151) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 18:39:30.719726 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.common.config [-] Logging enabled!
Jun 01 18:39:30.719980 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 18:39:30.720292 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98151) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 18:39:30.721240 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 18:39:30.721475 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 18:39:30.721829 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 18:39:30.722074 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 18:39:30.722300 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 18:39:30.722617 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.722910 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.723200 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.723427 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.723719 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.724007 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.724288 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.724611 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.724913 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.725204 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.725484 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.725768 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.726000 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.726282 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.726568 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.726857 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.727084 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] debug                          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.727367 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.727789 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.728192 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.728495 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.728784 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.729068 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.729876 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.730149 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.730430 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.730757 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] host                           = dv-cinder-794021-1-iscsi {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.731035 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.731319 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.731603 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.731884 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.732156 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.732449 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.732731 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.733002 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.733272 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.733546 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.733829 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.734112 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.734399 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.734623 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.734844 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.735132 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.735415 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.735694 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.735968 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.736239 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.736541 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.736814 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.737081 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.737364 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.737647 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.737927 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.738198 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.738469 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.738740 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.739007 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.739288 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.739558 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.739828 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.740098 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.740379 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.740674 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.740943 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.741246 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.741528 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.741810 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.742090 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.742366 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.742645 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.742913 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.743184 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.743460 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.743728 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.743994 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.744276 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.744566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.744838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.745667 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.745944 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.746229 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:30.746526 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.746822 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.747121 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.747403 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.747697 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.747977 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.748263 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.748563 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.748852 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.749136 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.749421 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.749698 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.749986 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.750260 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.750551 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.750851 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.751143 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.751430 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.751705 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.751977 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.752251 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.752551 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.752836 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.753126 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.753413 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.753685 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.753962 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.754248 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.754524 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.754795 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.755070 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.755355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.755631 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.755908 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.756187 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.756482 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.756756 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.757026 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.757301 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.757591 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.757867 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.758138 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.758408 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.758683 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.758955 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.759235 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.759511 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.759783 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.760054 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.760330 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.760663 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.760940 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.761215 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.761486 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.761762 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.762034 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.762307 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.762585 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.762853 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.763126 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.763397 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.763669 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.763944 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.764216 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.764512 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.764787 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.765058 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.765330 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.765618 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.765918 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.766196 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.766486 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.766755 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.767031 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.767861 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.767861 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.768091 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.768369 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.768667 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.768957 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.769241 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.769529 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.769813 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.770093 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.770391 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.770667 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.770948 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.771226 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.771502 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.771791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.772075 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.772364 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.772700 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.772974 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.773263 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.773555 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.773837 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.774145 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.774423 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:30.774641 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 18:39:30.774882 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98151) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 01 18:39:31.123474 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:39:31.123663 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:39:31.123959 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:39:31.124293 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 01 18:39:31.511145 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.511419 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.511701 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.513041 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.513318 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.513584 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.548983 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.549261 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.549529 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.562459 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.562737 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.563007 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.592273 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.592576 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.592849 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.628956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.629233 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.629513 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.860859 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7ff3cf46a700> agent after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.861391 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7ff3cf46a700> agent after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.861391 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7ff3cf3dc1f0> segment precommit_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.861658 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7ff3cf3dc4c0> network precommit_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.862393 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7ff3cf3e3670> segment before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.985848 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> network before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.986165 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7ff3cf3b4ca0> agent before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.986444 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> network before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.986719 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.986988 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.987295 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> segment precommit_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.987556 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> segment precommit_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.987811 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> segment after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.988061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> segment after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.988337 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> network after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.988628 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> network precommit_delete 0 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.988892 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port provisioning_complete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.989153 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.989406 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.989669 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> agent after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.989934 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> subnet after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.990189 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> subnet precommit_delete 0 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.990458 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.990711 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.990993 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> segment_host_mapping after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.991334 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.991583 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.991828 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> port after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.992106 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.992353 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.992622 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7ff3cfcf5550>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:31.993003 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.993240 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.993481 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.993713 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.993944 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.994175 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:31.994538 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 01 18:39:31.998199 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 01 18:39:32.002124 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 01 18:39:32.005897 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(50, 99)])])
Jun 01 18:39:32.007649 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 01 18:39:32.008093 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 01 18:39:32.008455 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 01 18:39:32.008833 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 01 18:39:32.011640 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 01 18:39:32.011893 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 01 18:39:32.012240 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 18:39:32.039335 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 01 18:39:32.039737 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7ff3cf308a30>> qos_plugin after_init 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.040035 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98151) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 01 18:39:32.040399 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7ff3cf3083a0>> logging-plugin after_init 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.042300 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98151) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 01 18:39:32.042579 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 18:39:32.042821 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 01 18:39:32.046239 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7ff3cf3a3c10>> floatingip before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.046525 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7ff3cf3a3c10>> port before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.108870 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 01 18:39:32.109107 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 01 18:39:32.109340 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 01 18:39:32.109699 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 01 18:39:32.139305 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 01 18:39:32.464756 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing driver for type 'gre'
Jun 01 18:39:32.465284 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] gre ID ranges: [(1, 1000)]
Jun 01 18:39:32.515943 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing driver for type 'local'
Jun 01 18:39:32.516279 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing driver for type 'vlan'
Jun 01 18:39:32.527678 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] VlanTypeDriver initialization complete
Jun 01 18:39:32.528058 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing driver for type 'vxlan'
Jun 01 18:39:32.528668 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] vxlan ID ranges: [(1, 1000)]
Jun 01 18:39:32.579818 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing extension driver 'port_security'
Jun 01 18:39:32.580158 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.extensions.port_security [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] PortSecurityExtensionDriver initialization complete
Jun 01 18:39:32.580527 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing mechanism driver 'openvswitch'
Jun 01 18:39:32.580857 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing mechanism driver 'hyperv'
Jun 01 18:39:32.588082 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.plugins.ml2.plugin [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98151) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:32.589234 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f490>> port after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.589815 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f490>> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.590309 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f490>> port after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.590857 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f640>> subnet after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.591359 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f640>> subnet after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.591779 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3cf54f640>> subnet after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.592288 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d280>> network after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.592904 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d280>> network after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.593657 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d280>> network after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.594204 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d4f0>> security_group after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.594712 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d4f0>> security_group after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.595192 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d4f0>> security_group after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.595885 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d790>> security_group_rule after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.596272 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d790>> security_group_rule after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.596766 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7d790>> security_group_rule after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.597246 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7da00>> address_group after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.597782 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7da00>> address_group after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.598200 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7ff3ced7da00>> address_group after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.598626 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] ML2 OVO RPC backend initialized. {{(pid=98151) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 01 18:39:32.599703 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> router_interface after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.600248 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> router_interface after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.600775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> network before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.601317 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> networks before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.601749 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> port before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.602183 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> ports before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.602764 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> subnet before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.603220 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> subnets before_response 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.603666 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> network after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.604164 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> network after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.604646 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> network after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.605146 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> port after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.605663 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.606131 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> port after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.606503 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> subnet after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.606989 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> subnet after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.607388 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7ff3ced7ddf0>> subnet after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.608246 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.plugin [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Modular L2 Plugin initialization complete
Jun 01 18:39:32.608695 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading services supported by the core plugin {{(pid=98151) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 01 18:39:32.609184 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.plugins.ml2.managers [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Got port-security extension from driver 'port_security'
Jun 01 18:39:32.609905 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.extensions.vlantransparent [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Disabled vlantransparent extension.
Jun 01 18:39:32.610484 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98151) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 01 18:39:32.611061 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: router
Jun 01 18:39:32.649301 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router_interface before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.649689 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_create 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.650058 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router before_create 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.650429 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router_interface before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.650800 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router_interface after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.651181 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_delete 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.651537 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> floatingip after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.651906 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_create 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.652251 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.652624 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.652973 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router_gateway after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.653326 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.653731 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.654096 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7ff3cf5209d0> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.654429 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7ff3cf5208b0> port after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.654759 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7ff3cf520940> subnet after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.655089 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7ff3cf520a60> subnetpool_address_scope after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.655698 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> port precommit_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.656050 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_create 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.656674 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7ff3cf50f310> port before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.657014 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.657372 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router after_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.657713 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_delete 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.658057 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_create 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.658415 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router_interface after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.658758 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> router precommit_update 55549900 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.659130 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7ff3ced89040>> network after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.659974 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Tracking information for resource: router configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:32.660307 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Tracking information for resource: floatingip configured {{(pid=98151) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 18:39:32.665197 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.db.l3_agentschedulers_db [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 01 18:39:32.665760 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7ff3ced03d30> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.666117 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7ff3ced03c10> port after_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.666463 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _notify_port_delete at 0x7ff3ced03ca0> port after_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.667338 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7ff3cecf9040> port after_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.668104 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7ff3ced226d0>> router before_create 55550100 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.668488 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7ff3ced226d0>> router precommit_delete 55550100 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.668847 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7ff3ced226d0>> router precommit_create 55550100 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.669199 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7ff3ced226d0>> router precommit_update 55550100 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.673718 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.provider_configuration [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service providers = [] {{(pid=98151) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 01 18:39:32.674080 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.db.servicetype_db [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98151) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 01 18:39:32.677114 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.service_base [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98151) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 18:39:32.677468 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.service_base [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98151) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 18:39:32.677809 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.service_base [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98151) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 18:39:32.678674 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.services.service_base [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98151) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 18:39:32.679044 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.services.service_base [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 01 18:39:32.679417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.679732 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 01 18:39:32.690637 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.690969 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: auto_allocate
Jun 01 18:39:32.696708 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7ff3ced403a0> network precommit_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.697073 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7ff3ced403a0> network precommit_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.697579 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.697895 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: tag
Jun 01 18:39:32.704593 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.704923 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: timestamp
Jun 01 18:39:32.708613 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.708938 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: network_ip_availability
Jun 01 18:39:32.714092 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3ced36d60>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.714459 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3ced36d60>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.714852 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3ced36d60>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.715503 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.715822 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: flavors
Jun 01 18:39:32.720681 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.721012 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading Plugin: revisions
Jun 01 18:39:32.725195 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98151) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 18:39:32.725583 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.602s {{(pid=98151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:39:32.726302 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98151) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 01 18:39:32.726634 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Initializing extension manager.
Jun 01 18:39:32.727131 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: __init__.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.727467 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: __pycache__ {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.727796 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.728124 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: address_group.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.728881 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.729958 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: address-group
Jun 01 18:39:32.730278 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: address_scope.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.730966 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.731472 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: address-scope
Jun 01 18:39:32.731791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: admin_state_down_before_update.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.732712 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.733219 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: router-admin-state-down-before-update
Jun 01 18:39:32.733538 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: agent.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.734207 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.734710 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: agent
Jun 01 18:39:32.735029 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: agent_resources_synced.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.735897 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.736397 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: agent-resources-synced
Jun 01 18:39:32.736739 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: allowedaddresspairs.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.738437 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.738953 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: allowed-address-pairs
Jun 01 18:39:32.739275 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: auto_allocated_topology.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.740313 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.740871 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: auto-allocated-topology
Jun 01 18:39:32.741191 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: availability_zone.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.741864 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.742376 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: availability_zone
Jun 01 18:39:32.742699 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: availability_zone_filter.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.743596 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.744097 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: availability_zone_filter
Jun 01 18:39:32.744414 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: data_plane_status.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.745864 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.746367 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension data-plane-status not supported by any of loaded plugins
Jun 01 18:39:32.746682 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: default_subnetpools.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.747569 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.748073 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: default-subnetpools
Jun 01 18:39:32.748392 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: dhcpagentscheduler.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.749193 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.749698 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: dhcp_agent_scheduler
Jun 01 18:39:32.750019 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: dns.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.750907 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.751406 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension dns-integration not supported by any of loaded plugins
Jun 01 18:39:32.751722 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: dns_domain_ports.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.752633 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.753133 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 01 18:39:32.753450 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: dvr.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.754099 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.754597 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: dvr
Jun 01 18:39:32.754917 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: empty_string_filtering.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.755795 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.756295 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: empty-string-filtering
Jun 01 18:39:32.756645 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.757767 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.758271 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 01 18:39:32.758588 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.759457 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.759956 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 01 18:39:32.760271 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: external_net.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.761195 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.761700 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: external-net
Jun 01 18:39:32.762019 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: extra_dhcp_opt.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.762890 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.763402 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: extra_dhcp_opt
Jun 01 18:39:32.763719 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: extraroute.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.764622 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.765125 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: extraroute
Jun 01 18:39:32.765439 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: extraroute_atomic.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.766446 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.766949 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: extraroute-atomic
Jun 01 18:39:32.767531 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: filter_validation.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.768346 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.768883 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: filter-validation
Jun 01 18:39:32.769202 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: fip_pf_description.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.770098 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.770583 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 01 18:39:32.770909 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: fip_port_details.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.771791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.772294 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: fip-port-details
Jun 01 18:39:32.772662 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: flavors.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.773870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.774380 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: flavors
Jun 01 18:39:32.774703 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.776359 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.776896 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 01 18:39:32.777225 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: floatingip_pools.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.777901 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.778403 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: floatingip-pools
Jun 01 18:39:32.778723 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: ip_allocation.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.779617 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.780121 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension ip_allocation not supported by any of loaded plugins
Jun 01 18:39:32.780457 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.781350 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.781864 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: ip-substring-filtering
Jun 01 18:39:32.782189 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l2_adjacency.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.783079 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.783581 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 01 18:39:32.783897 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.784870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.785388 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: router
Jun 01 18:39:32.785707 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3_conntrack_helper.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.787901 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.788451 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 01 18:39:32.788783 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.789695 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.790212 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: ext-gw-mode
Jun 01 18:39:32.790537 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.791436 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.792500 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: l3-ha
Jun 01 18:39:32.792822 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3_flavors.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.793707 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.794215 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: l3-flavors
Jun 01 18:39:32.794534 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.795429 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.795936 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 01 18:39:32.796255 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: l3agentscheduler.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.797298 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.797814 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: l3_agent_scheduler
Jun 01 18:39:32.798137 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: logging.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.799602 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.800122 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension logging not supported by any of loaded plugins
Jun 01 18:39:32.800490 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: metering.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.801215 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.801793 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: metering
Jun 01 18:39:32.802118 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.803291 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.803809 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: metering_source_and_destination_fields
Jun 01 18:39:32.804134 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: multiprovidernet.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.805060 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.805569 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: multi-provider
Jun 01 18:39:32.805891 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: netmtu.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.806769 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.807276 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: net-mtu
Jun 01 18:39:32.808145 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: netmtu_writable.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.809053 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.809562 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: net-mtu-writable
Jun 01 18:39:32.809885 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: network_availability_zone.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.810529 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.811035 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: network_availability_zone
Jun 01 18:39:32.811360 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: network_ip_availability.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.812417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.812959 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: network-ip-availability
Jun 01 18:39:32.813282 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: network_segment_range.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.814024 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.814525 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension network-segment-range not supported by any of loaded plugins
Jun 01 18:39:32.814843 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: pagination.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.815798 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.816124 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: pagination
Jun 01 18:39:32.816462 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: port_device_profile.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.817347 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.817852 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: port-device-profile
Jun 01 18:39:32.818170 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.819050 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.819552 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: port-mac-address-regenerate
Jun 01 18:39:32.819870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.820789 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.821300 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: port-numa-affinity-policy
Jun 01 18:39:32.821619 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: port_resource_request.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.822506 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.823034 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension port-resource-request not supported by any of loaded plugins
Jun 01 18:39:32.823355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: portbindings.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.824253 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.824787 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: binding
Jun 01 18:39:32.825107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: portbindings_extended.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.826360 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.826871 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: binding-extended
Jun 01 18:39:32.827194 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: portsecurity.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.828084 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.828636 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: port-security
Jun 01 18:39:32.828961 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: project_id.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.829903 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.830227 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: project-id
Jun 01 18:39:32.830543 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: providernet.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.831447 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.831958 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: provider
Jun 01 18:39:32.832276 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.835749 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.836267 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos not supported by any of loaded plugins
Jun 01 18:39:32.836631 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.837842 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.838354 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 01 18:39:32.838707 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.839595 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.840108 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 01 18:39:32.840453 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_default.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.841335 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.841844 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-default not supported by any of loaded plugins
Jun 01 18:39:32.842167 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_fip.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.842793 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.843296 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-fip not supported by any of loaded plugins
Jun 01 18:39:32.843617 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_gateway_ip.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.844539 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.845044 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 01 18:39:32.845362 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_port_network_policy.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.846236 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.846736 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 01 18:39:32.847054 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_rule_type_details.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.847933 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.848453 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 01 18:39:32.848784 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: qos_rules_alias.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.849791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.850296 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 01 18:39:32.850615 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: quotasv2.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.851612 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.851934 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: quotas
Jun 01 18:39:32.852248 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: quotasv2_detail.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.853867 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.854725 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: quota_details
Jun 01 18:39:32.855059 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: rbac.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.856076 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.856633 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: rbac-policies
Jun 01 18:39:32.856963 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: rbac_address_group.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.857861 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.858622 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: rbac-address-group
Jun 01 18:39:32.858946 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: rbac_address_scope.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.859831 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.860339 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: rbac-address-scope
Jun 01 18:39:32.860685 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: rbac_security_groups.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.861566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.862079 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: rbac-security-groups
Jun 01 18:39:32.862382 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: rbac_subnetpool.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.863280 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.863788 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: rbac-subnetpool
Jun 01 18:39:32.864106 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: revisionifmatch.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.865025 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.865533 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: revision-if-match
Jun 01 18:39:32.865852 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: revisions.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.866932 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.867439 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: standard-attr-revisions
Jun 01 18:39:32.867763 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: router_availability_zone.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.868411 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.868939 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: router_availability_zone
Jun 01 18:39:32.869260 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: routerservicetype.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.870739 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.871255 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension router-service-type not supported by any of loaded plugins
Jun 01 18:39:32.871574 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.872495 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.873009 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: security-groups-normalized-cidr
Jun 01 18:39:32.873329 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: security_groups_port_filtering.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.874221 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.874723 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: port-security-groups-filtering
Jun 01 18:39:32.875043 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.875928 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.876443 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: security-groups-remote-address-group
Jun 01 18:39:32.876775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: securitygroup.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.887437 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.887963 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: security-group
Jun 01 18:39:32.888291 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: segment.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.889084 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.889593 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension segment not supported by any of loaded plugins
Jun 01 18:39:32.889917 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.890821 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.891345 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 01 18:39:32.891650 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: servicetype.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.893021 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.893539 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: service-type
Jun 01 18:39:32.893862 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: sorting.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.894821 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.895149 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: sorting
Jun 01 18:39:32.895472 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: standard_attr_segment.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.896348 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.896878 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 01 18:39:32.897197 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: standardattrdescription.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.897818 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.898319 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: standard-attr-description
Jun 01 18:39:32.898636 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: stateful_security_group.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.899525 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.900028 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: stateful-security-group
Jun 01 18:39:32.900345 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: stdattrs_common.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.900930 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 01 18:39:32.901276 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.902248 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.902756 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 01 18:39:32.903074 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnet_onboard.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.904106 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.904648 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: subnet_onboard
Jun 01 18:39:32.904968 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.905855 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.906357 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 01 18:39:32.906675 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnet_service_types.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.907564 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.908073 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: subnet-service-types
Jun 01 18:39:32.908394 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnetallocation.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.909474 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.909986 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: subnet_allocation
Jun 01 18:39:32.910309 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.910950 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.911468 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: subnetpool-prefix-ops
Jun 01 18:39:32.911795 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.912718 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.913226 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 01 18:39:32.913544 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: tagging.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.914558 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.915073 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: standard-attr-tag
Jun 01 18:39:32.915398 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: timestamp.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.916599 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.917635 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loaded extension: standard-attr-timestamp
Jun 01 18:39:32.917955 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: trunk.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.918952 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.919463 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension trunk not supported by any of loaded plugins
Jun 01 18:39:32.919783 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: trunk_details.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.920697 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.921211 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension trunk-details not supported by any of loaded plugins
Jun 01 18:39:32.921529 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: uplink_status_propagation.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.922418 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.922925 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 01 18:39:32.923243 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Loading extension file: vlantransparent.py {{(pid=98151) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 18:39:32.923885 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98151) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 18:39:32.924388 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 01 18:39:32.926802 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:network
Jun 01 18:39:32.927515 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnet
Jun 01 18:39:32.928280 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 18:39:32.928929 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:port
Jun 01 18:39:32.930170 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.930599 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service FLAVORS assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.931240 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.931669 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.931996 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:router
Jun 01 18:39:32.932750 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 18:39:32.933446 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service METERING assigned prefix: /metering {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.935217 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3cec172b0>> rbac-policy before_create 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.935590 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3cec172b0>> rbac-policy before_update 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.935939 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7ff3cec172b0>> rbac-policy before_delete 55550000 {{(pid=98151) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:39:32.937088 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 18:39:32.937543 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 18:39:32.938207 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 18:39:32.938921 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service CORE assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.939248 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 18:39:32.939583 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] subnetpool is already registered
Jun 01 18:39:32.940178 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service CORE assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.940523 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 18:39:32.940844 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] subnetpool is already registered
Jun 01 18:39:32.943398 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.943828 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service FLAVORS assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.944415 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.944856 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.945185 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:router
Jun 01 18:39:32.945512 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] router is already registered
Jun 01 18:39:32.946091 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 18:39:32.946414 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] floatingip is already registered
Jun 01 18:39:32.947031 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service METERING assigned prefix: /metering {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.947689 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 18:39:32.948564 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] rbac_policy is already registered
Jun 01 18:39:32.949100 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 18:39:32.949437 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] security_group is already registered
Jun 01 18:39:32.950013 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 18:39:32.950350 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] security_group_rule is already registered
Jun 01 18:39:32.951022 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service CORE assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.951348 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 18:39:32.951671 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] subnetpool is already registered
Jun 01 18:39:32.952264 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.v2.resource_helper [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Service CORE assigned prefix:  {{(pid=98151) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 18:39:32.952614 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 18:39:32.952934 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING neutron.quota.resource_registry [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] subnetpool is already registered
Jun 01 18:39:32.953558 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: extensions {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.955002 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: address-groups {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.956651 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: address-scopes {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.957872 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: agents {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.959476 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: auto-allocated-topology {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.960750 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: availability_zones {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.962061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: dhcp-networks {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.963493 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: dhcp-agents {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.965040 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: routers {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.966798 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: flavors {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.967949 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: service_profiles {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.969183 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: next_providers {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.970697 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: service_profiles {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.972141 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: floatingip-pools {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.973386 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: routers {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.975192 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: floatingips {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.976410 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: l3-routers {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.977836 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: l3-agents {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.979773 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: metering-labels {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.981134 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: metering-label-rules {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.982599 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: network-ip-availabilities {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.984179 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: bindings {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.985885 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: quotas {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.992919 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: quotas {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.994362 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: rbac-policies {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.997787 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: security-groups {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:32.999023 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: security-group-rules {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.000278 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: service-providers {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.001544 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: subnetpools {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.113791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: subnetpools {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.115257 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.116998 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.118826 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.121179 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.122968 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.124854 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.126552 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.128479 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.130235 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.132091 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron.api.extensions [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Extended resource: tags {{(pid=98151) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 18:39:33.138102 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING keystonemiddleware.auth_token [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 01 18:39:33.143093 dv-cinder-794021-1-iscsi neutron-server[98151]: WARNING keystonemiddleware.auth_token [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 01 18:39:33.151856 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Acquired lock "singleton_lock" {{(pid=98151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 01 18:39:33.152334 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_concurrency.lockutils [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Releasing lock "singleton_lock" {{(pid=98151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 01 18:39:33.152984 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Starting 2 workers
Jun 01 18:39:33.157662 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Started child 98258 {{(pid=98151) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 18:39:33.162579 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Started child 98259 {{(pid=98151) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 18:39:33.163828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.164490 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO neutron.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Neutron service started, listening on 0.0.0.0:9696
Jun 01 18:39:33.164773 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Notify callbacks [] for process, before_spawn {{(pid=98151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.165386 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [-] (98258) wsgi starting up on http://0.0.0.0:9696
Jun 01 18:39:33.166640 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.167901 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Starting 1 workers
Jun 01 18:39:33.168715 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [-] (98259) wsgi starting up on http://0.0.0.0:9696
Jun 01 18:39:33.173471 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Started child 98260 {{(pid=98151) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 18:39:33.174235 dv-cinder-794021-1-iscsi neutron-server[98151]: INFO oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Starting 1 workers
Jun 01 18:39:33.176749 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] calling RpcWorker wait() {{(pid=98260) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 01 18:39:33.177304 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] returning from RpcWorker wait() {{(pid=98260) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 01 18:39:33.178548 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.178666 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Started child 98261 {{(pid=98151) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 18:39:33.179044 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:33.179423 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG neutron_lib.callbacks.manager [None req-63283584-966f-4515-9dd6-9ef74a46f4c5 None None] Notify callbacks [] for process, after_spawn {{(pid=98151) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.181323 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98151) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 18:39:33.181530 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 18:39:33.181714 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 18:39:33.181929 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 18:39:33.182260 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 18:39:33.182485 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 18:39:33.182977 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.183254 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.183388 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:33.183854 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.183854 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.184064 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.184311 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:33.184627 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.184898 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.185153 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.185431 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.185680 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.185850 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.186011 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.186249 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.186497 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.186802 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.187060 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.187299 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.187570 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.187737 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.187993 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.188255 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.188534 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.188782 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.189029 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.189522 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.189747 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.189984 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.190215 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.190497 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.190751 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.191012 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.191263 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.191466 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.191718 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.191964 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.192193 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.192460 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.192643 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.192908 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.193120 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.193584 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] host                           = dv-cinder-794021-1-iscsi {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.193798 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.194042 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.194284 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.194528 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.194797 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.195024 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.195271 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.195511 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.195749 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.195984 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.196240 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.196499 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.196712 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.196969 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.197130 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.197356 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.197644 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.197903 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.198131 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.198338 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.198474 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.198704 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.198865 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.199120 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.199371 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.199672 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.199819 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.200001 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.200211 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.200456 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.200686 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.200911 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.201123 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.201373 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.201599 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.201820 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.202041 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.202282 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.202490 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.202699 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.202916 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.203122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.203360 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.203567 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.203835 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.204062 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.204314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.204597 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.204842 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.205060 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.205282 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.205489 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.205757 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.205986 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.206224 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.206465 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.207795 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.208035 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.208255 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.209912 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.210182 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.210421 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.210656 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.210936 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.211228 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.211421 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.211645 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.211918 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.212116 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.212646 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.213010 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.214455 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.214455 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.214455 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.214870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.216400 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.216772 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.217166 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.217481 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.217837 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.218102 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.218395 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.218657 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.219009 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.221170 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.221467 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.222600 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.222914 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.223199 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.223493 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.223791 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.224148 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.224494 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.224753 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.22/identity {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.225047 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.225309 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.226020 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.226254 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.226509 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.227347 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.227602 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.227912 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.228177 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.228417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.231578 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.231845 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.232104 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.232356 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.232645 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.232921 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.233175 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.233412 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.233641 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.233861 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.234108 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.234329 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.234597 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.234838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.235119 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.235352 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.235574 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.235798 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.236013 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.236263 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.236961 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.240338 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.240615 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.240887 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.241135 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.241391 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.241663 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.241920 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.242173 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.242396 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.242626 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.242851 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.243081 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.243305 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.243525 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.243750 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.243972 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.244183 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.244399 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.244922 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.245144 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.245599 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.248308 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.252734 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.252988 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.253236 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.253474 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.253717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.253942 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.254702 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.255040 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.255297 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.255584 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.255835 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.256084 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.256347 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.256658 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.256931 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.257154 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.257401 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.257679 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.257914 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.258173 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.258444 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.258689 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.258946 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.259192 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.259430 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.259657 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.259906 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.260142 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.260605 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.260866 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.261166 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.261429 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.261712 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.262003 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.262281 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.262544 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.262766 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.263031 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.263326 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.263597 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.263855 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.264088 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.264459 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.264720 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.264970 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.265218 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.265452 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.265708 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.265959 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.266231 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.266489 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.266724 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.266945 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.267173 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.267751 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.268014 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.268234 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.268493 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.268767 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.269061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.269403 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.269684 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.269937 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.270176 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.270475 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.270708 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.22/identity {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.270929 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.271163 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.271390 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.271602 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.271813 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.272027 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.272279 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.272516 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.272731 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.272990 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.273235 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.273452 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.273693 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.273910 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.274124 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.274395 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.274608 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.274831 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.275078 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.275300 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.275515 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.275729 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.275940 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.276767 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.276991 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.277258 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.277507 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.277754 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.277996 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.278261 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.278512 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.278792 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.279033 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.279251 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.279464 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.279693 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.279928 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.280138 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.280368 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.280618 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.280830 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.281081 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.281318 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.281655 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.281917 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.282143 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.282378 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.282607 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.282819 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.283229 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.283477 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.283693 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.283908 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.284146 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.284417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.284698 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.285010 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.285164 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.285370 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.285598 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.285810 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.286020 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287646 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287646 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.287646 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.288112 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.288112 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.288384 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.288638 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.288909 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289050 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289192 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289336 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289561 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289766 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.289973 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.290207 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.290421 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.290664 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.290930 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.291150 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.291361 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.291566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.292512 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.292746 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.293008 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.293994 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.293994 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.293994 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.293994 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.295566 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.296121 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.296121 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.296284 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.296478 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.296733 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.297026 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.297309 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:50:99'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.297568 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.297836 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.298078 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.298417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.298890 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.299041 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.299182 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.299435 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.299657 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.299872 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.300087 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.300322 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.300578 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.300809 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.300979 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:33.301197 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.301350 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.301485 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.301678 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.301932 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.302172 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.302413 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.302647 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.302870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.303017 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 18:39:33.303601 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98151) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 18:39:33.303762 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 18:39:33.303905 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 18:39:33.304055 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 18:39:33.304227 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 18:39:33.304369 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 18:39:33.304596 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.304757 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.304918 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305077 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305236 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305414 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305582 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305728 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305862 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.305998 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306152 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306292 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306453 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306593 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306754 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.306903 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307040 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307200 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307386 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307539 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307683 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307817 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.307973 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308114 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308301 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308502 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308645 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308778 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.308911 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309065 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309207 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309510 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309667 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309811 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.309948 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310083 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310242 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310403 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310542 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310700 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] host                           = dv-cinder-794021-1-iscsi {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.310850 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.311062 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.311221 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.312899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.313924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.314926 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.315775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.316838 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317614 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317614 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317614 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317614 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317897 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.317897 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318037 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318138 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318298 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318456 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318615 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318772 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.318928 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319086 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319242 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319398 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319554 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319709 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.319866 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320022 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320179 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320335 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320516 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320674 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320831 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.320988 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.321144 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 18:39:33.321322 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.321488 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.321662 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.321821 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.321981 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322141 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322299 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322458 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322618 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322775 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.322963 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323124 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323295 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323454 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323614 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323776 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.323936 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324096 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324254 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324412 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324592 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324750 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.324924 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325085 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325246 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.22/identity {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325404 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325564 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325724 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.325889 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326355 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326579 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326647 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326795 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.326954 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327113 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327274 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327434 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327597 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327760 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.327909 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328070 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328230 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328389 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328570 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328731 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.328892 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329052 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329212 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329382 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329540 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329698 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.329857 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330016 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330173 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330332 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330495 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330653 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330812 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.330971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331142 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331303 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331462 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331621 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331780 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.331940 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332100 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332258 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332418 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332595 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332755 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.332915 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333073 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333233 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333393 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333551 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333711 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.333870 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334028 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334187 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334346 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334505 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334664 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.334830 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335002 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335163 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335321 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335482 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335640 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335799 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.335958 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336117 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336277 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336450 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336615 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336776 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.336939 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337098 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337257 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337415 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337575 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337734 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.337895 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.338055 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.338213 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.338372 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339028 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339204 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339364 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339524 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339693 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339898 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.339990 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340167 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340337 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340508 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340664 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340859 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.340986 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341112 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341252 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341417 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341575 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341782 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.341907 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342027 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342173 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342342 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342501 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342660 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.342818 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343075 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343209 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343331 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343452 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343601 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343761 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.343920 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344078 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344238 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344397 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344578 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344739 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.22/identity {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.344899 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345061 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345222 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345383 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345559 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345684 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.345843 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346004 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346166 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346325 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346509 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346659 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346818 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.346978 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347139 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347300 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347459 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347620 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347768 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.347927 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348088 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348247 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348408 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348587 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348748 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.348902 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349064 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349224 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349386 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349548 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349708 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.349889 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350053 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350214 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350375 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350536 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350696 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.350904 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.351037 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.351161 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.351354 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.351477 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.351617 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352565 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352948 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.352948 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353078 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353143 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353291 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353456 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353618 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353779 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.353940 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.354101 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.354310 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.354533 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.354681 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.354887 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.355026 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.355390 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.355390 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.355390 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.356107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.356107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.356107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.356107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.356107 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357122 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.357971 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.358668 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.358668 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.358668 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.358668 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.358668 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359009 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359009 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359148 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359266 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359425 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359597 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359757 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.359920 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360147 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360246 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360370 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360654 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360778 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.360864 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.361785 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.361785 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.361785 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.361785 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:50:99'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.361785 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.363956 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.365717 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.366314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.366314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.366314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.366314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 18:39:33.366314 dv-cinder-794021-1-iscsi neutron-server[98151]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 18:39:33.485356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58334) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:39:33.493847 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [-] 10.222.0.22 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0063739
Jun 01 18:39:44.300599 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9beeb29e-f541-4829-9512-4ee878f4dfbb None None] get_active_networks_info from dv-cinder-794021-1-iscsi {{(pid=98260) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 01 18:39:44.380668 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-dbbae7c0-3a88-4388-b498-6f6b7049f80b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:44.391342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9beeb29e-f541-4829-9512-4ee878f4dfbb None None] No non-hosted networks {{(pid=98260) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 01 18:39:46.684907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-0cfd46ef-6c4d-46a0-9fc6-87f77c0d7bf5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:46.774294 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-0073d9ff-fc53-48a6-a27b-a39a9e036f52 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:46.840450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:46.842885 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.844345 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.845106 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.848537 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.849695 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.851534 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.851885 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.852249 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.852616 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.852955 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.853288 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.853620 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:46.854057 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7ff3ce06b190>, 'Open vSwitch agent', 'dv-cinder-794021-1-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:46.861358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7ff3ce015760>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-794021-1-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:39:47.796944 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:49.465271 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:50.826834 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58426) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:39:51.397296 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING oslo_policy.policy [None req-737018e4-2564-46c3-ab2c-d960c7ec35a3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:51.397911 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING oslo_policy.policy [None req-737018e4-2564-46c3-ab2c-d960c7ec35a3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:51.609839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [None req-737018e4-2564-46c3-ab2c-d960c7ec35a3 admin admin] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:39:51.610787 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-737018e4-2564-46c3-ab2c-d960c7ec35a3 admin admin] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.7831132
Jun 01 18:39:53.669305 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.db.l3_hamode_db [None req-a5d3cd36-344f-42d8-a6d9-572ee8472ac7 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 01 18:39:53.755784 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5d3cd36-344f-42d8-a6d9-572ee8472ac7 None None] Routers set() bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:39:53.756126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5d3cd36-344f-42d8-a6d9-572ee8472ac7 None None] Router IDs set() for agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 01 18:39:53.947570 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58440) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:39:54.303059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'shared': True, 'default_prefixlen': 26}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:39:54.406747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.policy [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98259) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 18:39:54.452766 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING oslo_policy.policy [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:54.453140 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING oslo_policy.policy [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:54.461873 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.quota [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7ff3ce631190>.
Jun 01 18:39:54.477004 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:39:54.536480 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817527349', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817505304', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817514714', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817030158', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817041045', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792817014583', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1003089', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-565385', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1663754', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1590007'] for rbac-policy, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:54.603379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:54.605176 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a46f58af-2702-49f5-b895-6b4bde92b62e admin admin] 10.222.0.22 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6566491
Jun 01 18:39:57.165048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58452) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:39:57.733211 dv-cinder-794021-1-iscsi neutron-server[98258]: WARNING oslo_policy.policy [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:57.733776 dv-cinder-794021-1-iscsi neutron-server[98258]: WARNING oslo_policy.policy [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:57.943590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Request body: {'network': {'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'name': 'private', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:39:57.945217 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.quota [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7ff3ce947d90>.
Jun 01 18:39:57.960391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:39:57.967404 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Usage tracker for resource:network and tenant:e6813091d48e45c6806d61b2e7125d9a is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:39:57.972989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:39:57.980835 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:39:57.995843 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Made reservation on behalf of e6813091d48e45c6806d61b2e7125d9a for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:39:58.066113 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.policy [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98258) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 18:39:58.111399 dv-cinder-794021-1-iscsi neutron-server[98258]: WARNING oslo_policy.policy [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:58.111763 dv-cinder-794021-1-iscsi neutron-server[98258]: WARNING oslo_policy.policy [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 18:39:58.121772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.142196 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.157483 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:39:58.161098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Usage tracker for resource:security_group_rule and tenant:e6813091d48e45c6806d61b2e7125d9a is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:39:58.166027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:39:58.172059 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:39:58.268761 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.272089 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.277995 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:39:58.295059 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] vlan segment allocate from pool success with {'vlan_id': 60, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:39:58.321011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792820669471', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.321536 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7ff3cf3dc1f0> segment precommit_create {{(pid=98258) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 18:39:58.322006 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Added segment 68ee71e4-cf0f-4124-a123-f7cc5ed62666 of type vlan for network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472
Jun 01 18:39:58.373596 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27b69ca1-03cd-4a41-a5cf-681e8c3c0ba4,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:39:58.390490 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.390842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.391176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.391513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.391817 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.392149 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.392750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.393065 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.393394 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.393707 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.394011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.394317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Tracked resource versions report:
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]: pushed versions:
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]: {   'AddressGroup': {'1.2'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'ConntrackHelper': {'1.0'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Log': {'1.0'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Network': {'1.1'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Port': {'1.7'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'PortForwarding': {'1.2'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'QosPolicy': {'1.8'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SecurityGroup': {'1.4'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SubPort': {'1.0'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Subnet': {'1.1'},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Trunk': {'1.1'}}
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]: consumer versions:
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Log': '1.0',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Network': '1.1',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Port': '1.7',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'PortForwarding': '1.2',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'QosPolicy': '1.8',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SecurityGroup': '1.4',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SubPort': '1.0',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Subnet': '1.1',
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Trunk': '1.1'}}
Jun 01 18:39:58.395427 dv-cinder-794021-1-iscsi neutron-server[98258]:  {{(pid=98258) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:39:58.437996 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:39:58.444281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.482809 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.484272 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:39:58.484934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:39:58.489373 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:39:58.588872 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 848 time: 1.4215438
Jun 01 18:39:58.595201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Pushing event updated for resources: {'Network': ['ID=17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:39:58.600223 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:39:58.608461 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:40:01.201289 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58474) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:01.645868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a90c4be5-6654-48df-9cc7-f850ef653c9b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:01.647212 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a90c4be5-6654-48df-9cc7-f850ef653c9b admin admin] 10.222.0.22 "GET /v2.0/networks/17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 HTTP/1.1" status: 200  len: 824 time: 0.4449413
Jun 01 18:40:01.675910 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-056e92be-adfa-44b5-82ff-6397f3729ee9 admin admin] 10.222.0.22 "GET /v2.0/subnetpools/72661e64-fafe-478c-b6f8-0b999bffbc5f HTTP/1.1" status: 200  len: 734 time: 0.0233979
Jun 01 18:40:01.684450 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:40:01.688748 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:40:01.692670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Usage tracker for resource:subnet and tenant:e6813091d48e45c6806d61b2e7125d9a is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:40:01.695547 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:40:01.701862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:40:01.711250 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Made reservation on behalf of e6813091d48e45c6806d61b2e7125d9a for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:40:01.713566 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:02.169307 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:02.174235 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:02.253066 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa4f08b5-e3ed-478d-b13e-63a35410ce49,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:02.255009 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Checking segment: {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:40:02.255366 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Network hostable DHCP agents. Network: 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:40:02.260503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:02.274991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:40:02.284897 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:02.289189 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:02.289786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:02.294457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c41189e-8fce-4f6d-95d7-46717911d926 None None] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:40:02.310396 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6296268
Jun 01 18:40:02.600062 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:40:02.601334 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:02.782948 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Allocated IP 172.20.0.2 (17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472/aa4f08b5-e3ed-478d-b13e-63a35410ce49/332fed34-521c-45a8-9255-3d930adb5cfc) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:40:03.010260 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:03.023407 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Transition to ACTIVE for port object 332fed34-521c-45a8-9255-3d930adb5cfc will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:40:03.043104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Transition to ACTIVE for port object 332fed34-521c-45a8-9255-3d930adb5cfc will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:40:03.049919 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:03.053955 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:03.115311 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:40:03.118147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:03.126212 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:40:03.134474 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Pushing event updated for resources: {'Port': ['ID=332fed34-521c-45a8-9255-3d930adb5cfc,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:03.143700 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.144039 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.144369 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.144715 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.145035 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.145371 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.145671 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.145983 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.146312 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.146625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.146934 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.147242 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Tracked resource versions report:
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]: pushed versions:
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]: {   'AddressGroup': {'1.2'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'ConntrackHelper': {'1.0'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Log': {'1.0'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Network': {'1.1'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Port': {'1.7'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'PortForwarding': {'1.2'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'QosPolicy': {'1.8'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SecurityGroup': {'1.4'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SubPort': {'1.0'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Subnet': {'1.1'},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Trunk': {'1.1'}}
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]: consumer versions:
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Log': '1.0',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Network': '1.1',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Port': '1.7',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'PortForwarding': '1.2',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'QosPolicy': '1.8',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SecurityGroup': '1.4',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SubPort': '1.0',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Subnet': '1.1',
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Trunk': '1.1'}}
Jun 01 18:40:03.148325 dv-cinder-794021-1-iscsi neutron-server[98260]:  {{(pid=98260) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:40:03.184667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:03.238141 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Attempting to bind port 332fed34-521c-45a8-9255-3d930adb5cfc on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:40:03.238531 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Attempting to bind port 332fed34-521c-45a8-9255-3d930adb5cfc by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:40:03.238949 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Attempting to bind port 332fed34-521c-45a8-9255-3d930adb5cfc on network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:40:03.244019 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 39, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:40:03.244971 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Checking segment: {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:40:03.245425 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:03.245809 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Bound using segment: {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:40:03.246305 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Bound port: 332fed34-521c-45a8-9255-3d930adb5cfc, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:40:03.246671 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:03.335457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] For port 332fed34-521c-45a8-9255-3d930adb5cfc, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:40:03.339758 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] For port 332fed34-521c-45a8-9255-3d930adb5cfc, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=332fed34-521c-45a8-9255-3d930adb5cfc,segment=NetworkSegment(68ee71e4-cf0f-4124-a123-f7cc5ed62666),segment_id=68ee71e4-cf0f-4124-a123-f7cc5ed62666)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:40:03.344116 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:03.348837 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:03.433177 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Pushing event updated for resources: {'Port': ['ID=332fed34-521c-45a8-9255-3d930adb5cfc,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:03.436236 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:04.658772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58482) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:05.031070 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [None req-3855cd31-5097-4c68-a62b-c9914631fb54 admin admin] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98258) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:40:05.032061 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3855cd31-5097-4c68-a62b-c9914631fb54 admin admin] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3723443
Jun 01 18:40:07.355225 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58490) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:07.729588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [None req-97cd54ac-6ec9-48ff-8cb0-b4ba732f9923 admin admin] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98258) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:40:07.730575 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-97cd54ac-6ec9-48ff-8cb0-b4ba732f9923 admin admin] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3743534
Jun 01 18:40:08.650029 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 332fed34-521c-45a8-9255-3d930adb5cfc up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:08.721757 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 332fed34-521c-45a8-9255-3d930adb5cfc completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:40:08.928655 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dd17c21-b701-4d5b-8e04-d3c319360351 None None] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:40:09.033838 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Provisioning for port 332fed34-521c-45a8-9255-3d930adb5cfc completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:40:09.048190 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Provisioning complete for port 332fed34-521c-45a8-9255-3d930adb5cfc triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:09.048621 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:09.266821 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:09.315418 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] For port 332fed34-521c-45a8-9255-3d930adb5cfc, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=332fed34-521c-45a8-9255-3d930adb5cfc,segment=NetworkSegment(68ee71e4-cf0f-4124-a123-f7cc5ed62666),segment_id=68ee71e4-cf0f-4124-a123-f7cc5ed62666)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:40:09.320604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:09.322450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:09.391528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Pushing event updated for resources: {'Port': ['ID=332fed34-521c-45a8-9255-3d930adb5cfc,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:09.394978 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:09.546370 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-93acadb1-e1df-4cbc-804b-ad31ae3a0185 None None] Provisioning complete for port 332fed34-521c-45a8-9255-3d930adb5cfc triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:09.546659 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-93acadb1-e1df-4cbc-804b-ad31ae3a0185 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.343049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58504) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:10.630855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 332fed34-521c-45a8-9255-3d930adb5cfc up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:10.689685 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:40:10.694481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:40:10.698803 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Usage tracker for resource:router and tenant:e6813091d48e45c6806d61b2e7125d9a is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:40:10.702040 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:40:10.707813 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:40:10.716986 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.718624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.718770 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 332fed34-521c-45a8-9255-3d930adb5cfc triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:10.719097 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.739853 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.847600 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.865379 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:10.866562 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-69cc8b1e-e217-4af1-adbd-4ba52e1b43bc admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5225472
Jun 01 18:40:12.230434 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:40:13.163723 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58512) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:13.529373 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [None req-994c31fb-33b8-436d-91ae-141bbcd8418d admin admin] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:40:13.530336 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-994c31fb-33b8-436d-91ae-141bbcd8418d admin admin] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3656974
Jun 01 18:40:14.088807 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-20b9d9c2-7934-44bb-8af3-2a247b7f1db0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:15.839221 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58520) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:16.193949 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Request body: {'network': {'is_default': True, 'router:external': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'name': 'public', 'admin_state_up': True}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:40:16.199486 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:40:16.208641 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Usage tracker for resource:network and tenant:488f7c1b22734d299d7cfe6aeaed66e4 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:40:16.212345 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:40:16.219146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:40:16.228573 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Made reservation on behalf of 488f7c1b22734d299d7cfe6aeaed66e4 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:40:16.231297 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.247352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.261495 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:40:16.265108 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Usage tracker for resource:security_group_rule and tenant:488f7c1b22734d299d7cfe6aeaed66e4 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:40:16.268414 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:40:16.273915 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:40:16.367569 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.371242 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.376801 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:16.388239 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Reserving flat network on physical network physnet1 {{(pid=98259) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 01 18:40:16.418667 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792820669471', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.419258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7ff3cf3dc1f0> segment precommit_create {{(pid=98259) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 18:40:16.419722 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Added segment 8cb30134-8767-4a68-8c75-632abd865f06 of type flat for network 51c15cd0-3fb9-458f-96e0-aa926a3585bf
Jun 01 18:40:16.472270 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5d38e22-eef5-4f9e-9cf4-90a1ce316fa0,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:16.494715 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.495069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.495471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.495872 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.496264 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.496748 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.497077 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.497392 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.497725 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.498040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.498352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.498661 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Tracked resource versions report:
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]: pushed versions:
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]: {   'AddressGroup': {'1.2'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'ConntrackHelper': {'1.0'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Log': {'1.0'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Network': {'1.1'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Port': {'1.7'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'PortForwarding': {'1.2'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'QosPolicy': {'1.8'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SecurityGroup': {'1.4'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SubPort': {'1.0'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Subnet': {'1.1'},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Trunk': {'1.1'}}
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]: consumer versions:
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Log': '1.0',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Network': '1.1',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Port': '1.7',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'PortForwarding': '1.2',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'QosPolicy': '1.8',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SecurityGroup': '1.4',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SubPort': '1.0',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Subnet': '1.1',
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Trunk': '1.1'}}
Jun 01 18:40:16.499738 dv-cinder-794021-1-iscsi neutron-server[98259]:  {{(pid=98259) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:40:16.546517 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.553482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:16.591134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.592754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:16.593486 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.597112 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:16.684857 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8b14fa9c-7e14-43b8-9bcc-25343d9ce1eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:16.701099 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.8608136
Jun 01 18:40:16.706089 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Pushing event updated for resources: {'Network': ['ID=51c15cd0-3fb9-458f-96e0-aa926a3585bf,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:16.723052 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:16.730543 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:40:16.847932 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:17.730752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:19.001106 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58542) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:19.208759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f48688bc-f328-4abc-be5b-ee16452d978c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:19.210089 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f48688bc-f328-4abc-be5b-ee16452d978c admin admin] 10.222.0.22 "GET /v2.0/subnets/aa4f08b5-e3ed-478d-b13e-63a35410ce49 HTTP/1.1" status: 200  len: 849 time: 0.2080278
Jun 01 18:40:19.381327 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a5934836-8922-4bc7-9333-8e783d80ca15 admin admin] 10.222.0.22 "GET /v2.0/routers/f5fbc7f1-531b-44c6-abb0-934f3c2adc2a HTTP/1.1" status: 200  len: 704 time: 0.1652603
Jun 01 18:40:19.421936 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:19.848946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.086095 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Allocated IP 172.20.0.1 (17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472/aa4f08b5-e3ed-478d-b13e-63a35410ce49/b8750596-74a2-4e17-a320-6dee2612b91f) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:40:20.238582 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.256509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Transition to ACTIVE for port object b8750596-74a2-4e17-a320-6dee2612b91f will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:40:20.310606 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.315012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:20.377759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:40:20.378740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:20.382266 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:40:20.382947 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.528720 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Pushing event updated for resources: {'Port': ['ID=b8750596-74a2-4e17-a320-6dee2612b91f,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:20.535789 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:20.632487 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2c2f1ea8-b5bb-4f9e-97ca-97a4b1389e6d None None] Provisioning for port b8750596-74a2-4e17-a320-6dee2612b91f completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:40:20.638046 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2c2f1ea8-b5bb-4f9e-97ca-97a4b1389e6d None None] Provisioning complete for port b8750596-74a2-4e17-a320-6dee2612b91f triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:20.638416 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-2c2f1ea8-b5bb-4f9e-97ca-97a4b1389e6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.684864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.690891 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-2c2f1ea8-b5bb-4f9e-97ca-97a4b1389e6d None None] Port b8750596-74a2-4e17-a320-6dee2612b91f cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:40:20.907785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.912191 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.913390 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:20.917864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:21.009603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Pushing event updated for resources: {'Port': ['ID=b8750596-74a2-4e17-a320-6dee2612b91f,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:21.013558 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:21.106865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:40:21.107905 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:21.292982 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:40:21.311515 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-93d1c8ce-d223-4bf3-92ad-27375460c467 None None] Provisioning complete for port b8750596-74a2-4e17-a320-6dee2612b91f triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:21.311889 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-93d1c8ce-d223-4bf3-92ad-27375460c467 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:21.366074 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-93d1c8ce-d223-4bf3-92ad-27375460c467 None None] Port b8750596-74a2-4e17-a320-6dee2612b91f cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:40:21.443151 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:40:21.452469 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] 10.222.0.22 "PUT /v2.0/routers/f5fbc7f1-531b-44c6-abb0-934f3c2adc2a/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.0658672
Jun 01 18:40:21.452686 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53087925-8bcf-4792-b988-372f82304384 None None] Sync routers for ids ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:40:21.463536 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] Routers {'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:40:21.464402 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce8ec160>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:40:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:21.634247 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] Set router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:40:22.001432 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce8ec160>, [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:20Z', 'revision_number': 2, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port_host': None, '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:20Z', 'revision_number': 2, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:22.006246 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53087925-8bcf-4792-b988-372f82304384 None None] Checking router: f5fbc7f1-531b-44c6-abb0-934f3c2adc2a for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:40:22.006616 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53087925-8bcf-4792-b988-372f82304384 None None] Updating router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a port b8750596-74a2-4e17-a320-6dee2612b91f binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:40:22.058373 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.428396 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.442985 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-53087925-8bcf-4792-b988-372f82304384 None None] Transition to ACTIVE for port object b8750596-74a2-4e17-a320-6dee2612b91f will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:40:22.449810 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.456115 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:22.672656 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Pushing event updated for resources: {'Port': ['ID=b8750596-74a2-4e17-a320-6dee2612b91f,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:22.676205 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-53087925-8bcf-4792-b988-372f82304384 None None] Attempting to bind port b8750596-74a2-4e17-a320-6dee2612b91f on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:40:22.676623 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-53087925-8bcf-4792-b988-372f82304384 None None] Attempting to bind port b8750596-74a2-4e17-a320-6dee2612b91f by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:40:22.677053 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53087925-8bcf-4792-b988-372f82304384 None None] Attempting to bind port b8750596-74a2-4e17-a320-6dee2612b91f on network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:40:22.685466 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53087925-8bcf-4792-b988-372f82304384 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 40, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:40:22.685822 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53087925-8bcf-4792-b988-372f82304384 None None] Checking segment: {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:40:22.686296 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.686682 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53087925-8bcf-4792-b988-372f82304384 None None] Bound using segment: {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:40:22.687244 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-53087925-8bcf-4792-b988-372f82304384 None None] Bound port: b8750596-74a2-4e17-a320-6dee2612b91f, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68ee71e4-cf0f-4124-a123-f7cc5ed62666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 60, 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:40:22.687549 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.701671 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.702012 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.702345 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.702671 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.702994 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.703313 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.703628 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.703944 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.704265 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.704620 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.704932 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.705241 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Tracked resource versions report:
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]: pushed versions:
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]: {   'AddressGroup': {'1.2'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'ConntrackHelper': {'1.0'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Log': {'1.0'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Network': {'1.1'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Port': {'1.7'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'PortForwarding': {'1.2'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'QosPolicy': {'1.8'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SecurityGroup': {'1.4'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SubPort': {'1.0'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Subnet': {'1.1'},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Trunk': {'1.1'}}
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]: consumer versions:
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Log': '1.0',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Network': '1.1',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Port': '1.7',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'PortForwarding': '1.2',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'QosPolicy': '1.8',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SecurityGroup': '1.4',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SubPort': '1.0',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Subnet': '1.1',
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Trunk': '1.1'}}
Jun 01 18:40:22.706344 dv-cinder-794021-1-iscsi neutron-server[98261]:  {{(pid=98261) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:40:22.734295 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:22.783655 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-53087925-8bcf-4792-b988-372f82304384 None None] For port b8750596-74a2-4e17-a320-6dee2612b91f, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:40:22.788054 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-53087925-8bcf-4792-b988-372f82304384 None None] For port b8750596-74a2-4e17-a320-6dee2612b91f, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=b8750596-74a2-4e17-a320-6dee2612b91f,segment=NetworkSegment(68ee71e4-cf0f-4124-a123-f7cc5ed62666),segment_id=68ee71e4-cf0f-4124-a123-f7cc5ed62666)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:40:22.792963 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-53087925-8bcf-4792-b988-372f82304384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:22.797518 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:22.881819 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] Routers {'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:40:22.882452 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce8ec160>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:40:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:22.930959 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Pushing event updated for resources: {'Port': ['ID=b8750596-74a2-4e17-a320-6dee2612b91f,revision_number=4']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:22.940330 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:23.068495 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] Set router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:40:23.391670 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-53087925-8bcf-4792-b988-372f82304384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce8ec160>, [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:20Z', 'revision_number': 2, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port_host': None, '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:22Z', 'revision_number': 4, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:23.395627 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53087925-8bcf-4792-b988-372f82304384 None None] The sync data for ids ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'] in dv-cinder-794021-1-iscsi is: [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:20Z', 'revision_number': 2, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port_host': None, '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:22Z', 'revision_number': 4, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:40:23.600233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 58562) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:23.766170 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bacf37d6-d236-4369-9f60-add04512afd6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:23.772713 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-bacf37d6-d236-4369-9f60-add04512afd6 admin admin] 10.222.0.22 "GET /v2.0/networks/51c15cd0-3fb9-458f-96e0-aa926a3585bf HTTP/1.1" status: 200  len: 842 time: 0.1662192
Jun 01 18:40:23.776816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Request body: {'subnet': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'name': 'public-subnet', 'enable_dhcp': False, 'gateway_ip': '172.27.0.1', 'cidr': '172.27.0.0/24', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:40:23.781340 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:40:23.785055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Usage tracker for resource:subnet and tenant:488f7c1b22734d299d7cfe6aeaed66e4 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:40:23.787788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:40:23.793957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:40:23.803979 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Made reservation on behalf of 488f7c1b22734d299d7cfe6aeaed66e4 for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:40:23.806858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:24.210573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.objects.ports [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=98258) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 01 18:40:24.211034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:24.215429 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a12e0350-31fc-4a76-9d3f-48b0141cc737 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:24.284241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c252d780-bee9-4a2c-a569-c3a5207a21ad,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:24.287523 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:24.293553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:40:24.293907 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Network hostable DHCP agents. Network: 51c15cd0-3fb9-458f-96e0-aa926a3585bf, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:40:24.310116 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:40:24.318697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 51c15cd0-3fb9-458f-96e0-aa926a3585bf) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:24.322650 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:24.323235 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:24.328488 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03d7dd09-118c-4452-81ae-517c7c6f4f37 None None] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:40:24.353741 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.5794952
Jun 01 18:40:24.527224 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c69f164f-fdd0-4968-ad9b-451587c46d2f None None] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:40:26.586915 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58574) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:26.648619 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device b8750596-74a2-4e17-a320-6dee2612b91f up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:26.717970 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port b8750596-74a2-4e17-a320-6dee2612b91f completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:40:26.722545 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port b8750596-74a2-4e17-a320-6dee2612b91f triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:26.722924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:26.790485 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-eaf91f27-a000-43c1-acc1-746d772184f4 admin admin] 10.222.0.22 "GET /v2.0/routers/f5fbc7f1-531b-44c6-abb0-934f3c2adc2a HTTP/1.1" status: 200  len: 710 time: 0.2010438
Jun 01 18:40:26.841298 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:26.874271 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port b8750596-74a2-4e17-a320-6dee2612b91f, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=b8750596-74a2-4e17-a320-6dee2612b91f,segment=NetworkSegment(68ee71e4-cf0f-4124-a123-f7cc5ed62666),segment_id=68ee71e4-cf0f-4124-a123-f7cc5ed62666)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:40:26.877924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:26.881489 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f51573d8-b07e-40dc-b35a-724f09cceb9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:26.925028 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26b532dd-4630-49c7-9ba8-a45373a52cb9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:40:26.925591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-26b532dd-4630-49c7-9ba8-a45373a52cb9 admin admin] Synchronizing usage tracker for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:40:26.942609 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-26b532dd-4630-49c7-9ba8-a45373a52cb9 admin admin] Unset dirty status for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:40:26.943757 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-26b532dd-4630-49c7-9ba8-a45373a52cb9 admin admin] 10.222.0.22 "GET /v2.0/networks/51c15cd0-3fb9-458f-96e0-aa926a3585bf HTTP/1.1" status: 200  len: 886 time: 0.1481984
Jun 01 18:40:26.950270 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=b8750596-74a2-4e17-a320-6dee2612b91f,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:26.952775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:40:26.953945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:27.440859 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:27.756227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:27.813621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:27.942484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Allocated IP 172.27.0.99 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/29ed6f25-c2b7-4f74-b3db-b6eae81e126e) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:40:28.084564 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:28.113200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:28.117929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:28.177543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:40:28.180312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:40:28.183373 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:40:28.248037 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Pushing event updated for resources: {'Port': ['ID=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:28.251268 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:28.604386 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:28.644065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device b8750596-74a2-4e17-a320-6dee2612b91f up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:28.709820 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port b8750596-74a2-4e17-a320-6dee2612b91f triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:28.710193 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:28.933177 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:28.936340 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1617286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1617295', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-2041815'] for router, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:29.105785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:40:29.275882 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:40:29.283794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:29.287214 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] 10.222.0.22 "PUT /v2.0/routers/f5fbc7f1-531b-44c6-abb0-934f3c2adc2a HTTP/1.1" status: 200  len: 889 time: 2.3357327
Jun 01 18:40:29.287358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Sync routers for ids ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:40:29.299799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Routers {'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:40:29.300524 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb783a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:40:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:29.518489 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Set router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:40:29.850185 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb783a0>, [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:28Z', 'revision_number': 4, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port': {'id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:f1:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:27Z', 'updated_at': '2021-06-01T18:40:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:26Z', 'revision_number': 5, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:29.855172 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Checking router: f5fbc7f1-531b-44c6-abb0-934f3c2adc2a for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:40:29.855539 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Updating router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:40:29.906120 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.225383 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.239316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Transition to ACTIVE for port object 29ed6f25-c2b7-4f74-b3db-b6eae81e126e will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:40:30.245969 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.250394 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:30.326506 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Attempting to bind port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:40:30.326877 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Attempting to bind port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:40:30.327237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Attempting to bind port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:40:30.330448 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Pushing event updated for resources: {'Port': ['ID=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:30.334161 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:30.335017 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 40, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:40:30.335382 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:40:30.335786 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.336149 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:40:30.336635 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Bound port: 29ed6f25-c2b7-4f74-b3db-b6eae81e126e, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:40:30.337002 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.405894 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] For port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:40:30.408773 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] For port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:40:30.413124 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:30.417316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:30.491608 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Routers {'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:40:30.492123 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb783a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:40:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:30.552044 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Pushing event updated for resources: {'Port': ['ID=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:30.556268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:30.671796 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] Set router f5fbc7f1-531b-44c6-abb0-934f3c2adc2a gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:40:31.014991 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb783a0>, [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:28Z', 'revision_number': 4, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port': {'id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:f1:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:27Z', 'updated_at': '2021-06-01T18:40:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:26Z', 'revision_number': 5, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:40:31.019307 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55ec65f-832f-4938-8be3-dc93f7a50329 None None] The sync data for ids ['f5fbc7f1-531b-44c6-abb0-934f3c2adc2a'] in dv-cinder-794021-1-iscsi is: [{'id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'name': 'router1', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:40:10Z', 'updated_at': '2021-06-01T18:40:28Z', 'revision_number': 4, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'gw_port': {'id': '29ed6f25-c2b7-4f74-b3db-b6eae81e126e', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:f1:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:27Z', 'updated_at': '2021-06-01T18:40:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'b8750596-74a2-4e17-a320-6dee2612b91f', 'name': '', 'network_id': '17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472', 'tenant_id': 'e6813091d48e45c6806d61b2e7125d9a', 'mac_address': 'fa:16:3e:87:8a:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5fbc7f1-531b-44c6-abb0-934f3c2adc2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:40:19Z', 'updated_at': '2021-06-01T18:40:26Z', 'revision_number': 5, 'project_id': 'e6813091d48e45c6806d61b2e7125d9a', 'subnets': [{'id': 'aa4f08b5-e3ed-478d-b13e-63a35410ce49', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '72661e64-fafe-478c-b6f8-0b999bffbc5f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:40:31.608438 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 58582) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:40:31.722052 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8da28235-520b-4d35-bd21-df517d7d39c5 admin admin] 10.222.0.22 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1124833
Jun 01 18:40:32.657902 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 29ed6f25-c2b7-4f74-b3db-b6eae81e126e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:32.733696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:40:32.738300 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:32.738666 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:32.859831 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:32.876876 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:40:32.880888 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:32.883016 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:40:32.951243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=29ed6f25-c2b7-4f74-b3db-b6eae81e126e,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:40:32.957738 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:40:34.685272 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 29ed6f25-c2b7-4f74-b3db-b6eae81e126e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:40:34.752191 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 29ed6f25-c2b7-4f74-b3db-b6eae81e126e triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:40:34.752602 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:44.092106 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f62268a6-ec3b-4312-a9dc-c013fc15226b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:46.703342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-bcb919d6-137e-4438-b8f5-50a0afb183ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:46.829672 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:47.738634 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:40:49.230101 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:40:49.456031 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:14.094624 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cfcb8f22-cd5c-4ee0-80b4-2514b6b4468c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:16.691457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3b68c8dc-54e5-4f2a-9e24-86aabd2b88a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:16.824747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:17.737839 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:19.443133 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:26.230239 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:41:44.097144 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8b437f27-ca23-44cb-8081-b974a8c0b8ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:46.683203 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cede25a1-32f6-4121-978c-575bbc456ecc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:46.833705 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:47.740418 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:41:49.448747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:03.230216 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:42:04.791251 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59152) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:04.856305 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.pecan_wsgi.hooks.translation [None req-14d5e6bf-23da-42b4-8f6b-7e5cce5b6eb9 admin admin] GET failed (client error): The resource could not be found.
Jun 01 18:42:04.857579 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-14d5e6bf-23da-42b4-8f6b-7e5cce5b6eb9 admin admin] 10.222.0.22 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0653870
Jun 01 18:42:04.983840 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-317b002a-b480-4a7f-bebd-ac7dadd96efe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:04.985281 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-317b002a-b480-4a7f-bebd-ac7dadd96efe admin admin] 10.222.0.22 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 871 time: 0.1239607
Jun 01 18:42:07.078128 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59162) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:07.185029 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a8bb580-b4e8-48c7-9889-a7a2cdbcc3ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:07.186379 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7a8bb580-b4e8-48c7-9889-a7a2cdbcc3ab admin admin] 10.222.0.22 "GET /v2.0/subnets/aa4f08b5-e3ed-478d-b13e-63a35410ce49 HTTP/1.1" status: 200  len: 849 time: 0.1073029
Jun 01 18:42:07.195286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:42:07.307018 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Notify callbacks [] for subnet, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:07.535598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8792820752532'] for subnet, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:07.539913 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:07.578233 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:07.579234 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:07.580243 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] 10.222.0.22 "PUT /v2.0/subnets/aa4f08b5-e3ed-478d-b13e-63a35410ce49 HTTP/1.1" status: 200  len: 868 time: 0.3883369
Jun 01 18:42:07.583161 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3462a8a0-50f2-4ddd-b94e-5f2de84282fa None None] Network 17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:42:07.605678 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa4f08b5-e3ed-478d-b13e-63a35410ce49,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:07.613597 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.613963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.614274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.614603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.614928 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.615271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.615600 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.615928 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.616249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.616659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.616980 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.617300 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:07.621593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:42:07.998236 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-12ddd734-7dfb-4ca2-a3c6-df07136a80c0 None None] Provisioning complete for port 332fed34-521c-45a8-9255-3d930adb5cfc triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:42:07.998605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12ddd734-7dfb-4ca2-a3c6-df07136a80c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:08.124855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-12ddd734-7dfb-4ca2-a3c6-df07136a80c0 None None] Provisioning complete for port b8750596-74a2-4e17-a320-6dee2612b91f triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:42:08.125116 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12ddd734-7dfb-4ca2-a3c6-df07136a80c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:09.696116 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59170) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:09.864807 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0bb8212-107c-4c3f-9dc6-a720e6b5b18c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:09.865286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0bb8212-107c-4c3f-9dc6-a720e6b5b18c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:09.866808 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f0bb8212-107c-4c3f-9dc6-a720e6b5b18c admin admin] 10.222.0.22 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1548 time: 0.1697168
Jun 01 18:42:11.955473 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59178) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:12.127034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926ce15-ce3f-4683-959e-b9ef3564a5f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:12.127422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926ce15-ce3f-4683-959e-b9ef3564a5f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:12.128955 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-e926ce15-ce3f-4683-959e-b9ef3564a5f1 admin admin] 10.222.0.22 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1548 time: 0.1725533
Jun 01 18:42:14.098641 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-50e4055c-3c5e-421e-b024-23f9e31d0596 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:14.232873 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59186) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:14.402256 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4effa785-c916-4f36-9320-01caa6868ad2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:14.403508 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4effa785-c916-4f36-9320-01caa6868ad2 admin admin] 10.222.0.22 "GET /v2.0/networks/17c3fdc3-9fdb-44e3-abe7-1fd17f3bd472 HTTP/1.1" status: 200  len: 868 time: 0.1696632
Jun 01 18:42:16.483524 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59194) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:16.656596 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9311621a-81a2-4c13-8956-cb4fe90b0ac7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:16.657947 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-9311621a-81a2-4c13-8956-cb4fe90b0ac7 admin admin] 10.222.0.22 "GET /v2.0/networks/51c15cd0-3fb9-458f-96e0-aa926a3585bf HTTP/1.1" status: 200  len: 886 time: 0.1734762
Jun 01 18:42:16.686391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c587cc89-57a1-4308-8c02-3db6ec511be7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:16.826725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:17.746183 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:18.758042 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59202) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:18.862460 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8095a19-fd4f-4216-9265-944dd781a4e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:18.862929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8095a19-fd4f-4216-9265-944dd781a4e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:18.864433 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b8095a19-fd4f-4216-9265-944dd781a4e1 admin admin] 10.222.0.22 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1052091
Jun 01 18:42:19.452236 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:20.956185 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59210) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:21.059554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b81aaa0-70c1-4c5b-9fe4-7e365e6079ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:21.060010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b81aaa0-70c1-4c5b-9fe4-7e365e6079ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:21.061503 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-6b81aaa0-70c1-4c5b-9fe4-7e365e6079ec admin admin] 10.222.0.22 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1042843
Jun 01 18:42:23.158732 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59218) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:23.265001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b9117ef-903d-46cd-b0a7-e15f76f84e15 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:23.266305 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3b9117ef-903d-46cd-b0a7-e15f76f84e15 admin admin] 10.222.0.22 "GET /v2.0/subnets/aa4f08b5-e3ed-478d-b13e-63a35410ce49 HTTP/1.1" status: 200  len: 868 time: 0.1066065
Jun 01 18:42:25.352286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59226) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:25.451298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2e69496-3ae8-41c2-9592-1e7314ea606b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:25.452647 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b2e69496-3ae8-41c2-9592-1e7314ea606b admin admin] 10.222.0.22 "GET /v2.0/subnets/c252d780-bee9-4a2c-a569-c3a5207a21ad HTTP/1.1" status: 200  len: 816 time: 0.0992835
Jun 01 18:42:40.228697 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:42:44.103586 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e6e8ea2c-6b05-44e8-9a50-8f25bed29a70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:46.686751 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d0f28654-6e9d-45b9-bb22-18fe08193903 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:46.830050 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:47.750250 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:48.201910 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59270) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:48.250501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [None req-0100022d-09ef-4927-ad6b-6d938ac2496e admin admin] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:42:48.251485 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0100022d-09ef-4927-ad6b-6d938ac2496e admin admin] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0486476
Jun 01 18:42:49.457685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:50.444578 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59278) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:50.508872 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.pecan_wsgi.hooks.translation [None req-d18f88e9-4b0c-4b07-8ca9-87f51e71775a admin admin] GET failed (client error): The resource could not be found.
Jun 01 18:42:50.510103 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d18f88e9-4b0c-4b07-8ca9-87f51e71775a admin admin] 10.222.0.22 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0645978
Jun 01 18:42:50.632977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c485d848-fecd-4a91-8385-4874a757b485 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:50.634339 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c485d848-fecd-4a91-8385-4874a757b485 admin admin] 10.222.0.22 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1205537
Jun 01 18:42:52.740348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59286) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:52.787003 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:42:52.792504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:42:52.801883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:42:52.811275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Made reservation on behalf of 488f7c1b22734d299d7cfe6aeaed66e4 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:42:52.813591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:52.899002 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING neutron.services.revisions.revision_plugin [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7ff3cdc73af0] {project_id='488f7c1b22734d299d7cfe6aeaed66e4', id='f400f467-4dfa-47d3-a8dd-7160de50f24b', target_tenant='*', action='access_as_shared', object_id='2f9e5c2b-747e-41b7-92e1-40dd1da829ed'}> to bump revision.
Jun 01 18:42:52.910864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] vlan segment allocate from pool success with {'vlan_id': 77, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:42:52.920381 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:52.920693 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Added segment cca38853-2470-455c-b471-569f58a7b8fe of type vlan for network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed
Jun 01 18:42:52.949258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:52.977004 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:52.978243 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:52.978816 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:52.983415 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:53.071817 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 846 time: 0.3303034
Jun 01 18:42:53.079175 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Pushing event updated for resources: {'Network': ['ID=2f9e5c2b-747e-41b7-92e1-40dd1da829ed,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:53.082649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:42:53.089999 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:42:55.176629 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59294) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:42:55.243113 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.pecan_wsgi.hooks.translation [None req-77eb471f-9f14-425c-bf2a-77a4a0d9977d admin admin] GET failed (client error): The resource could not be found.
Jun 01 18:42:55.243625 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-77eb471f-9f14-425c-bf2a-77a4a0d9977d admin admin] Synchronizing usage tracker for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:42:55.257825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-77eb471f-9f14-425c-bf2a-77a4a0d9977d admin admin] Unset dirty status for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:42:55.258913 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-77eb471f-9f14-425c-bf2a-77a4a0d9977d admin admin] 10.222.0.22 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0813050
Jun 01 18:42:55.360309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48cb309f-0612-48c0-8c09-0d68e2081330 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:55.361621 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-48cb309f-0612-48c0-8c09-0d68e2081330 admin admin] 10.222.0.22 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 825 time: 0.0988328
Jun 01 18:42:55.371503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Request body: {'subnet': {'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed', 'name': 'shared-subnet', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:42:55.375811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:42:55.379533 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Usage tracker for resource:subnet and tenant:488f7c1b22734d299d7cfe6aeaed66e4 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:42:55.382398 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Quota usage for subnet was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:42:55.387937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:42:55.430264 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Made reservation on behalf of 488f7c1b22734d299d7cfe6aeaed66e4 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:42:55.432616 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:55.812910 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:55.817127 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:55.884823 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=651f7706-feb5-49b8-bd41-f9b424b82cd6,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:55.887566 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:42:55.893671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Checking segment: {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:42:55.894276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Network hostable DHCP agents. Network: 2f9e5c2b-747e-41b7-92e1-40dd1da829ed, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:42:55.912611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:42:55.921807 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 2f9e5c2b-747e-41b7-92e1-40dd1da829ed) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:42:55.927423 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:42:55.927547 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:55.930427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68409c17-8060-4b16-8f83-48c7329121b3 None None] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:42:55.947871 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5796366
Jun 01 18:42:56.180748 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-2f9e5c2b-747e-41b7-92e1-40dd1da829ed', 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed', 'tenant_id': '488f7c1b22734d299d7cfe6aeaed66e4', 'fixed_ips': [{'subnet_id': '651f7706-feb5-49b8-bd41-f9b424b82cd6'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:42:56.181578 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.338477 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Allocated IP 192.168.233.2 (2f9e5c2b-747e-41b7-92e1-40dd1da829ed/651f7706-feb5-49b8-bd41-f9b424b82cd6/1d83695e-1822-4dc9-b2a7-30a3d93217df) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:42:56.542381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.552326 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Transition to ACTIVE for port object 1d83695e-1822-4dc9-b2a7-30a3d93217df will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:42:56.571564 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Transition to ACTIVE for port object 1d83695e-1822-4dc9-b2a7-30a3d93217df will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:42:56.577646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.582064 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:56.646504 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:42:56.649339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:42:56.652907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:42:56.683851 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Pushing event updated for resources: {'Port': ['ID=1d83695e-1822-4dc9-b2a7-30a3d93217df,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:56.722278 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.722625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.722966 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.723297 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.723626 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.723956 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.724277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.725141 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.725486 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.725807 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.726126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.726456 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:42:56.733799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:42:56.757270 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Attempting to bind port 1d83695e-1822-4dc9-b2a7-30a3d93217df on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:42:56.757631 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Attempting to bind port 1d83695e-1822-4dc9-b2a7-30a3d93217df by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:42:56.757985 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Attempting to bind port 1d83695e-1822-4dc9-b2a7-30a3d93217df on network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:42:56.763387 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 42, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:42:56.763757 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Checking segment: {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:42:56.764159 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.764582 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Bound using segment: {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:42:56.765048 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Bound port: 1d83695e-1822-4dc9-b2a7-30a3d93217df, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:42:56.765414 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.853198 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] For port 1d83695e-1822-4dc9-b2a7-30a3d93217df, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:42:56.856158 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] For port 1d83695e-1822-4dc9-b2a7-30a3d93217df, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=1d83695e-1822-4dc9-b2a7-30a3d93217df,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:42:56.860758 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:56.864576 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-67c5e6dc-f9bf-4d89-a300-58aea76aeca7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:56.945604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Pushing event updated for resources: {'Port': ['ID=1d83695e-1822-4dc9-b2a7-30a3d93217df,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:56.949746 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:42:57.703497 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7d499e6-b87a-49d2-b720-add360fd5155 None None] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:42:57.825037 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-75850fdc-7e25-4f67-b61e-e07953d6e8fa None None] Provisioning for port 1d83695e-1822-4dc9-b2a7-30a3d93217df completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:42:58.755779 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1d83695e-1822-4dc9-b2a7-30a3d93217df up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:42:58.826540 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 1d83695e-1822-4dc9-b2a7-30a3d93217df completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:42:58.831237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 1d83695e-1822-4dc9-b2a7-30a3d93217df triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:42:58.831601 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:58.946551 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:58.976924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 1d83695e-1822-4dc9-b2a7-30a3d93217df, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=1d83695e-1822-4dc9-b2a7-30a3d93217df,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:42:58.980556 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:42:58.982552 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:42:59.046057 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=1d83695e-1822-4dc9-b2a7-30a3d93217df,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:42:59.048944 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:43:00.736393 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1d83695e-1822-4dc9-b2a7-30a3d93217df up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:43:00.808106 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 1d83695e-1822-4dc9-b2a7-30a3d93217df triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:43:00.808501 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:14.104727 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-da7b2caf-1020-4489-b531-081f6af33757 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:16.690844 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-79efb597-a9c6-491c-a60b-4296c9d6e0cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:16.832669 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:17.228029 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:43:17.749065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:19.459702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:44.105638 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-aea787e9-4754-427b-848c-cf90ecab8382 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:46.685061 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-01e1a717-d8e1-4c68-9f61-32a4740af70f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:46.838772 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:47.753148 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:49.461817 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:43:54.226221 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:44:07.950864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59346) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:44:07.956719 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [None req-14a2aa57-3ea4-42f4-96ec-f9e22620c6ec tempest-verify_tempest_config-1538634060 tempest-verify_tempest_config-1538634060-project] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:44:07.958237 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-14a2aa57-3ea4-42f4-96ec-f9e22620c6ec tempest-verify_tempest_config-1538634060 tempest-verify_tempest_config-1538634060-project] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0058281
Jun 01 18:44:08.253143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59364) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:44:08.366227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.380563 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:44:08.384238 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Usage tracker for resource:security_group_rule and tenant:31217835b4e54dc6af66c8eb80126ef7 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:44:08.386950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:44:08.392620 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:44:08.470964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.474692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.485952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5ef28816-b9d2-4a03-ac84-1099e3a839d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:44:08.523481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Synchronizing usage tracker for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:44:08.527642 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48c3994b-08a1-4f4b-b24c-9afc43e2acd0,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:44:08.541864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.542237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.542640 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.543036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.543358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.543716 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.544079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.544395 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.544750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.545065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.545374 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.545681 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.550964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:44:08.557167 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Unset dirty status for tenant:488f7c1b22734d299d7cfe6aeaed66e4 on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:44:08.561186 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=31217835b4e54dc6af66c8eb80126ef7&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3070428
Jun 01 18:44:08.561378 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59368) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:44:08.619981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.646095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.742222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.746102 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:44:08.757067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48c3994b-08a1-4f4b-b24c-9afc43e2acd0,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:44:08.766468 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.766832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.767159 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.767481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.767910 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.768129 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.768473 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.768793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.769105 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.769672 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.769981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.770289 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:44:08.773235 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:08.777595 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/48c3994b-08a1-4f4b-b24c-9afc43e2acd0 HTTP/1.1" status: 204  len: 168 time: 0.2146270
Jun 01 18:44:08.777915 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:44:14.106454 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8a3e0129-69d2-474b-8689-4ad573f62553 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:16.686609 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3d809ab5-95b8-442b-bb08-06f63e0911c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:16.830698 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:17.756872 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:19.465369 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:31.225127 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:44:44.107455 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-a76bce75-5bb4-4b6c-9c44-15da7028d06f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:46.687135 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5ab2458c-2bbc-4c38-ba4e-ecffe67527e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:46.834733 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:47.768133 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:44:49.467684 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:08.222752 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 5 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:45:14.109904 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-194ff5d6-36bb-4dc4-aba8-1e82cf8ea915 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:16.689246 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e1519149-6340-4256-bec5-d28f53871347 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:16.836673 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:17.757188 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:19.471316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:39.037996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904'] for agent, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:42.289211 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59422) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:45:42.399505 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6e90eb12-c5c9-434d-bbc2-84c041904d4e admin admin] 10.222.0.22 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1091950
Jun 01 18:45:44.112006 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-96609121-8797-46c3-8ba9-fb74e4571c5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:44.481084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59432) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:45:44.534932 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6cf5c784-350d-4f37-8b27-891986969cf5 admin admin] 10.222.0.22 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0527489
Jun 01 18:45:45.221235 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:45:46.693740 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8a28ee93-27d0-4b37-9f67-573e6815f037 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:46.837784 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:47.767611 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:45:49.477919 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:08.991134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:14.113179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-850d063b-bdc6-4ef1-9283-0d8ff0a46417 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:16.695441 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-879537b1-c5d5-452f-8664-9f59457ad31f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:16.840103 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:17.762503 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:19.476980 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:22.220125 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:46:38.994027 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:44.114507 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-51534792-7423-4212-9b22-33120d134529 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:46.695950 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1ca55c2c-43ba-4c51-9675-470b583b074e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:46.840887 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:47.764069 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:49.482051 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:46:59.219317 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:47:08.715426 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59518) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:08.920008 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-423168063-network', 'tenant_id': 'e471347ca004404f94563ac66c74dc87'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:08.926362 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:08.934286 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Usage tracker for resource:network and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:08.939680 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:08.947589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:08.961633 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Made reservation on behalf of e471347ca004404f94563ac66c74dc87 for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:08.964490 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:08.992729 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:08.998450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.010695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:09.014593 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:09.017464 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:09.023850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:09.111868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.117132 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.120317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-848b9a89-09fa-4af6-b7cb-8cf5615c49af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:09.151728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5599ecda-dc5f-44de-ac90-58679762ae16,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:09.160717 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] vlan segment allocate from pool success with {'vlan_id': 61, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:09.163360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.163720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.164060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.164591 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.164928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.165268 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.165589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.165908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.166242 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.166679 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.166997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.167489 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Tracked resource versions report:
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]: pushed versions:
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]: {   'AddressGroup': {'1.2'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'ConntrackHelper': {'1.0'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Log': {'1.0'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Network': {'1.1'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Port': {'1.7'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'PortForwarding': {'1.2'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'QosPolicy': {'1.8'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SecurityGroup': {'1.4'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'SubPort': {'1.0'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Subnet': {'1.1'},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     'Trunk': {'1.1'}}
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]: consumer versions:
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     HyperV agent@hv-cinder-79402: {},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Log': '1.0',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Network': '1.1',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Port': '1.7',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'PortForwarding': '1.2',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'QosPolicy': '1.8',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SecurityGroup': '1.4',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'SubPort': '1.0',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Subnet': '1.1',
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:                                                      'Trunk': '1.1'}}
Jun 01 18:47:09.168697 dv-cinder-794021-1-iscsi neutron-server[98258]:  {{(pid=98258) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:47:09.173934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:09.180583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.180966 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Added segment 65814869-c1b9-439f-bc83-43e6e5c7712d of type vlan for network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f
Jun 01 18:47:09.216748 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.262316 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.264209 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:09.264749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.269979 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:09.372523 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.6530669
Jun 01 18:47:09.375555 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59570) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:09.377526 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Pushing event updated for resources: {'Network': ['ID=87c3456d-8d78-42d4-81e0-1f541c3dcc2f,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:09.380855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:09.383159 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Request body: {'subnet': {'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-423168063-subnet', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:09.388814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:09.389193 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:09.392730 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Usage tracker for resource:subnet and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:09.399874 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:09.406565 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:09.420055 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Made reservation on behalf of e471347ca004404f94563ac66c74dc87 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:09.423047 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.846449 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:09.851209 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8dbf5743-b7ec-4d4d-b44f-10caafbd0dca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:09.925775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=108da5f2-bebc-4996-9e93-e596166088ad,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:09.937830 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.938505 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.938847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.939181 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.939513 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.939840 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.940167 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.940505 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.941037 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.941365 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.941686 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.942000 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Tracked resource versions report:
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]: pushed versions:
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]: {   'AddressGroup': {'1.2'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'ConntrackHelper': {'1.0'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Log': {'1.0'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Network': {'1.1'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Port': {'1.7'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'PortForwarding': {'1.2'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'QosPolicy': {'1.8'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SecurityGroup': {'1.4'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'SubPort': {'1.0'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Subnet': {'1.1'},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     'Trunk': {'1.1'}}
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]: consumer versions:
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     HyperV agent@hv-cinder-79402: {},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Log': '1.0',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Network': '1.1',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Port': '1.7',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'PortForwarding': '1.2',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'QosPolicy': '1.8',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SecurityGroup': '1.4',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'SubPort': '1.0',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Subnet': '1.1',
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:                                                      'Trunk': '1.1'}}
Jun 01 18:47:09.943098 dv-cinder-794021-1-iscsi neutron-server[98259]:  {{(pid=98259) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:47:09.946883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:09.949868 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Checking segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:09.950223 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Network hostable DHCP agents. Network: 87c3456d-8d78-42d4-81e0-1f541c3dcc2f, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:09.967481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:09.979474 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 87c3456d-8d78-42d4-81e0-1f541c3dcc2f) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:09.988655 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6c20e36-5f0f-402a-a090-d13d613a753d None None] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:09.989313 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:09.989900 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.026498 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59602) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:10.026969 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.6491354
Jun 01 18:47:10.031263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:10.039172 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:10.043169 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Usage tracker for resource:router and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:10.049052 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:10.056551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:10.071029 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.072481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.093349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.263966 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:47:10.264843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.419162 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.463945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Allocated IP 172.20.0.2 (87c3456d-8d78-42d4-81e0-1f541c3dcc2f/108da5f2-bebc-4996-9e93-e596166088ad/8760df71-4d77-4700-92d9-3788d40c0a1a) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:10.677755 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59638) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:10.742694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.763015 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Transition to ACTIVE for port object 8760df71-4d77-4700-92d9-3788d40c0a1a will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:10.784827 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Transition to ACTIVE for port object 8760df71-4d77-4700-92d9-3788d40c0a1a will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:10.791618 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.799718 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:10.827180 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.862507 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:10.865412 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:10.868354 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:10.872392 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:10.919503 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Pushing event updated for resources: {'Port': ['ID=8760df71-4d77-4700-92d9-3788d40c0a1a,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:10.932187 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.932722 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.933215 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.933763 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.934230 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.934696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.935280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.935755 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.936233 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.936717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.937293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.937770 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Tracked resource versions report:
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]: pushed versions:
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]: {   'AddressGroup': {'1.2'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'ConntrackHelper': {'1.0'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Log': {'1.0'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Network': {'1.1'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Port': {'1.7'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'PortForwarding': {'1.2'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'QosPolicy': {'1.8'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SecurityGroup': {'1.4'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'SubPort': {'1.0'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Subnet': {'1.1'},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     'Trunk': {'1.1'}}
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]: consumer versions:
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     HyperV agent@hv-cinder-79402: {},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Log': '1.0',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Network': '1.1',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Port': '1.7',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'PortForwarding': '1.2',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'QosPolicy': '1.8',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SecurityGroup': '1.4',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'SubPort': '1.0',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Subnet': '1.1',
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:                                                      'Trunk': '1.1'}}
Jun 01 18:47:10.938979 dv-cinder-794021-1-iscsi neutron-server[98260]:  {{(pid=98260) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:47:10.986846 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:11.002437 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Attempting to bind port 8760df71-4d77-4700-92d9-3788d40c0a1a on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:11.003030 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Attempting to bind port 8760df71-4d77-4700-92d9-3788d40c0a1a by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:11.003584 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Attempting to bind port 8760df71-4d77-4700-92d9-3788d40c0a1a on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:11.009567 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 46, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:11.009943 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Checking segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:11.010340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.010732 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Bound using segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:11.011197 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Bound port: 8760df71-4d77-4700-92d9-3788d40c0a1a, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:11.011569 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.025260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Allocated IP 172.27.0.168 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/c380278f-9756-427c-a730-c226e79202b1) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:11.101833 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] For port 8760df71-4d77-4700-92d9-3788d40c0a1a, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:11.104974 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] For port 8760df71-4d77-4700-92d9-3788d40c0a1a, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8760df71-4d77-4700-92d9-3788d40c0a1a,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:11.110594 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.115752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:11.138255 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59654) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:11.153720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1257565037-network', 'tenant_id': '59a3ecd15231441e9ed00898e50aae60'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:11.160768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.175705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Usage tracker for resource:network and tenant:59a3ecd15231441e9ed00898e50aae60 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.182758 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.194147 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.229774 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Pushing event updated for resources: {'Port': ['ID=8760df71-4d77-4700-92d9-3788d40c0a1a,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:11.235258 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:11.237710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Made reservation on behalf of 59a3ecd15231441e9ed00898e50aae60 for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:11.240039 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.261448 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.274451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.291495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.298377 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Usage tracker for resource:security_group_rule and tenant:59a3ecd15231441e9ed00898e50aae60 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.306855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.315444 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.343079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59662) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:11.357632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59666) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:11.388095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.400219 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:11.493217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Pushing event updated for resources: {'Port': ['ID=c380278f-9756-427c-a730-c226e79202b1,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:11.496893 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:11.513027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:11.518398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:11.521890 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:11.581732 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-network', 'tenant_id': '41638d3f0658425aa2f15362df9748a1'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:11.587274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.592645 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Usage tracker for resource:network and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.598024 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.610244 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.625726 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Made reservation on behalf of 41638d3f0658425aa2f15362df9748a1 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:11.640227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.666769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.679642 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-142761807-network', 'tenant_id': 'c9d468526c1c413d84fd0bdf81022e86'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:11.692103 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.698222 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.700670 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Usage tracker for resource:network and tenant:c9d468526c1c413d84fd0bdf81022e86 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.704464 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.707334 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.713039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.715773 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.721558 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.735216 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Made reservation on behalf of c9d468526c1c413d84fd0bdf81022e86 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:11.737793 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.762268 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.772767 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.782783 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.785266 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.790178 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:11.791663 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Usage tracker for resource:security_group_rule and tenant:c9d468526c1c413d84fd0bdf81022e86 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.796811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.806613 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59678) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:11.813757 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.828186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] vlan segment allocate from pool success with {'vlan_id': 52, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:11.898933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.899274 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Added segment ade580c3-c29b-43be-bce2-a56993c1cb04 of type vlan for network d7df87fc-8cf1-444a-903c-77524e3d6866
Jun 01 18:47:11.907719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=859fe75d-7de7-4022-9d0f-9b2a5874b27c,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:11.908089 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.916042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:11.935467 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-network', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:11.941550 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:11.949372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:11.953614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Usage tracker for resource:network and tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:11.960618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:11.967684 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:11.986650 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1006526571-network', 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:11.989839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:11.996282 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Made reservation on behalf of 25a97ba1c3dd49d0bba7b78bbfa71df1 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:11.998952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.005784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.033023 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] vlan segment allocate from pool success with {'vlan_id': 58, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:12.043416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.043987 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Added segment 13fe2f88-2641-4a98-bd4a-51b0be7341a1 of type vlan for network d5efada3-47d7-493b-989f-ef9ac42a4054
Jun 01 18:47:12.072747 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.073878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.115564 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.133438 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.164831 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.169956 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:12.170848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.172868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.183116 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:12.183553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.191088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:12.204539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.212067 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.215124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Usage tracker for resource:network and tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.223895 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 1.0844944
Jun 01 18:47:12.225436 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.229485 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59698) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:12.231476 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.241546 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Request body: {'subnet': {'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-subnet', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:12.248416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] vlan segment allocate from pool success with {'vlan_id': 93, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:12.260501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.261278 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Added segment b98fe0e0-d95b-4d70-8bc1-3e865ab964cd of type vlan for network 1a1c7295-9260-4fd5-9efa-473de1975d6f
Jun 01 18:47:12.267959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.272848 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Usage tracker for resource:subnet and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.275686 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.281851 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.295061 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.340551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Usage tracker for resource:security_group_rule and tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.343926 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.346349 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.353044 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.356240 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Made reservation on behalf of 41638d3f0658425aa2f15362df9748a1 for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:12.359247 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.362178 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:12.362953 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.391530 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.401601 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 896 time: 1.0570257
Jun 01 18:47:12.402984 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=062b617c-2172-441b-93f2-e7c070ec6f65,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:12.407515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:12.409567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59704) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:12.409998 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.198s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:12.455433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Request body: {'subnet': {'network_id': '1a1c7295-9260-4fd5-9efa-473de1975d6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-142761807-subnet', 'tenant_id': 'c9d468526c1c413d84fd0bdf81022e86', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:12.459949 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.481719 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:12.481719 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.481719 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Usage tracker for resource:subnet and tenant:c9d468526c1c413d84fd0bdf81022e86 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.493547 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6630acce-d9b5-45da-9599-8180f1ac5e95 None None] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:12.561945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-33b4ba9e-34f1-416b-87fe-2d9003c5195f None None] Provisioning for port 8760df71-4d77-4700-92d9-3788d40c0a1a completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:12.570700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:12.586054 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.613485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Pushing event updated for resources: {'Network': ['ID=d5efada3-47d7-493b-989f-ef9ac42a4054,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:12.616836 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.623245 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.629877 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Usage tracker for resource:security_group_rule and tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.635765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.644527 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.651463 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network d5efada3-47d7-493b-989f-ef9ac42a4054 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:12.688307 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Pushing event updated for resources: {'Network': ['ID=d7df87fc-8cf1-444a-903c-77524e3d6866,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:12.695878 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.505s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:12.746769 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 2.0644801
Jun 01 18:47:12.753130 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59712) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:12.758591 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Request body: {'subnet': {'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1257565037-subnet', 'tenant_id': '59a3ecd15231441e9ed00898e50aae60', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:12.790246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:12.796675 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network d7df87fc-8cf1-444a-903c-77524e3d6866 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:12.810749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Usage tracker for resource:subnet and tenant:59a3ecd15231441e9ed00898e50aae60 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:12.815247 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:12.825774 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:12.915456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Made reservation on behalf of 59a3ecd15231441e9ed00898e50aae60 for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:12.918158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.013202 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8760df71-4d77-4700-92d9-3788d40c0a1a up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:13.019055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.139983 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 8760df71-4d77-4700-92d9-3788d40c0a1a completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:13.144116 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Pushing event updated for resources: {'Network': ['ID=1a1c7295-9260-4fd5-9efa-473de1975d6f,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:13.150945 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.152359 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.742s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.162222 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Made reservation on behalf of c9d468526c1c413d84fd0bdf81022e86 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:13.164150 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 8760df71-4d77-4700-92d9-3788d40c0a1a triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:13.164607 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.164745 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.209599 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 1a1c7295-9260-4fd5-9efa-473de1975d6f details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:13.261829 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.919s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.313939 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d1b483f-12a6-4bca-8c44-748d71e4ad40,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:13.319283 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.322131 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.323935 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.933s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.324473 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.338494 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.437113 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] vlan segment allocate from pool success with {'vlan_id': 92, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:13.461508 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad53f3e9-ca04-4913-841a-9a016a059a79,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:13.470451 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.479655 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.480196 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Added segment 8aee0e97-a508-4a4c-9292-a97cd5317182 of type vlan for network 2bc7607a-0e83-4423-b9b7-ac3e13607a13
Jun 01 18:47:13.556738 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.582160 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.598027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.602249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.618288 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 8760df71-4d77-4700-92d9-3788d40c0a1a, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8760df71-4d77-4700-92d9-3788d40c0a1a,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:13.623616 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.632047 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.640983 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] vlan segment allocate from pool success with {'vlan_id': 59, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:13.654550 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c3ec40a2-7655-4905-b338-7567c5c64312 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.694681 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.701977 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Added segment 69b1d8dc-90f3-4b2d-912f-ef992caee9a2 of type vlan for network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e
Jun 01 18:47:13.739749 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=8760df71-4d77-4700-92d9-3788d40c0a1a,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:13.766564 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.806567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=618cf6a3-a6b7-49d0-8c21-a5580355cfee,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:13.816076 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:13.817995 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.858704 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.864593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:13.865366 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:13.873610 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-43149f36-1deb-4a5c-b6cf-0f0e5dd4db51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:13.982020 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98258) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:47:14.009268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-74dd74e7-295a-4588-bcef-316f9ab6b29c None None] Provisioning complete for port 8760df71-4d77-4700-92d9-3788d40c0a1a triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:14.009819 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-74dd74e7-295a-4588-bcef-316f9ab6b29c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.022497 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.023134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Pushing event updated for resources: {'Network': ['ID=2bc7607a-0e83-4423-b9b7-ac3e13607a13,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:14.026988 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:14.028070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:14.028709 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.035256 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:14.051953 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:14.062898 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 2.2519403
Jun 01 18:47:14.078282 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59762) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:14.089520 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Request body: {'subnet': {'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1006526571-subnet', 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:14.112487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:14.123479 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Usage tracker for resource:subnet and tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:14.129826 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:14.131552 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 2.7723675
Jun 01 18:47:14.134935 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59766) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:14.144132 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:14.185349 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Request body: {'subnet': {'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-subnet', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:14.196698 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:14.198886 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Pushing event updated for resources: {'Network': ['ID=7c0d1d41-a033-4bad-b3c8-a15d3b31242e,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:14.203807 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:14.204743 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Usage tracker for resource:subnet and tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:14.217248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:14.222284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:14.234060 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:14.244504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Made reservation on behalf of 25a97ba1c3dd49d0bba7b78bbfa71df1 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:14.247438 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.276240 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:14.278499 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.423907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-909eedd7-0e58-4453-894e-502551914417 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.425476 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.450429 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.455733 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:14.468609 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:14.475296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d4df1d71-ebd2-461d-a996-5443c2bc9c69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:14.481903 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:14.482986 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce962d90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:46:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:14.496816 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-55748242-d222-4523-bef8-4fe1567029a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:14.592048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3bc46f81-88af-4aba-902a-90b4633edf6a,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:14.600560 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:14.612799 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.647866 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:14.658242 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f9b3dc05-bafd-43fc-ad38-331daf8470ac,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:14.664742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:14.682692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Checking segment: {'id': 'b98fe0e0-d95b-4d70-8bc1-3e865ab964cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '1a1c7295-9260-4fd5-9efa-473de1975d6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:14.683310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Network hostable DHCP agents. Network: 1a1c7295-9260-4fd5-9efa-473de1975d6f, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:14.693638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.697689 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 4.6675971
Jun 01 18:47:14.700774 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59798) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:14.730220 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Checking segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:14.730805 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Network hostable DHCP agents. Network: d5efada3-47d7-493b-989f-ef9ac42a4054, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:14.761721 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:14.787432 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Network 1a1c7295-9260-4fd5-9efa-473de1975d6f is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:14.820632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 1a1c7295-9260-4fd5-9efa-473de1975d6f) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:14.832162 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f94c84f-fa6c-4bb0-aff2-fad0be11b2bd None None] Network 1a1c7295-9260-4fd5-9efa-473de1975d6f requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:14.873914 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:14.906433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:14.910459 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:14.979588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, d5efada3-47d7-493b-989f-ef9ac42a4054) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:14.992829 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa5c0080-0016-4f5c-9594-aea703cda2d9,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:15.034373 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Checking segment: {'id': 'ade580c3-c29b-43be-bce2-a56993c1cb04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 52, 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:15.034925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Network hostable DHCP agents. Network: d7df87fc-8cf1-444a-903c-77524e3d6866, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:15.056682 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:15.057541 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.058951 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8760df71-4d77-4700-92d9-3788d40c0a1a up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:15.081308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.433s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:15.105335 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 2.6510856
Jun 01 18:47:15.122069 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 2.8840468
Jun 01 18:47:15.122312 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Network d7df87fc-8cf1-444a-903c-77524e3d6866 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:15.130744 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59828) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:15.156064 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:15.169516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, d7df87fc-8cf1-444a-903c-77524e3d6866) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:15.183776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:15.190396 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.199797 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce962d90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:11Z', 'revision_number': 3, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:15.200068 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:15.204875 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:15.205508 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Updating router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 port c380278f-9756-427c-a730-c226e79202b1 binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:15.214143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Usage tracker for resource:router and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:15.218501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:15.228356 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a5ef855-cebd-4021-b2e7-499205215252 None None] Network d5efada3-47d7-493b-989f-ef9ac42a4054 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:15.231122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:15.271742 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-796d9409-01a7-4189-9896-d23e92656ae6 None None] Network d7df87fc-8cf1-444a-903c-77524e3d6866 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:15.302955 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8702857d-8360-45b6-9b5c-124faedb4409 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 2.5486479
Jun 01 18:47:15.310333 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.440220 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 8760df71-4d77-4700-92d9-3788d40c0a1a triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:15.440961 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.532267 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.544625 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:15.684484 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b40008fb-ef5f-4ddd-be90-93c9dd2d5423,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:15.690902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:15.715487 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.720079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.748940 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Checking segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:15.749413 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Network hostable DHCP agents. Network: 2bc7607a-0e83-4423-b9b7-ac3e13607a13, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:15.755835 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.812943 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:15.836884 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 2bc7607a-0e83-4423-b9b7-ac3e13607a13) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:15.855553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:15.856749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:15.880143 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 1.7988517
Jun 01 18:47:15.905390 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-787cbc63-ab9b-4afe-b77e-d9d4ffdf1088 None None] Network 1a1c7295-9260-4fd5-9efa-473de1975d6f requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:15.972411 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3802ec74-3b39-43b3-a205-c427ba14f3f2 None None] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:16.088639 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.111665 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Transition to ACTIVE for port object c380278f-9756-427c-a730-c226e79202b1 will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:16.122523 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.136399 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:16.306646 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Attempting to bind port c380278f-9756-427c-a730-c226e79202b1 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:16.307013 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Attempting to bind port c380278f-9756-427c-a730-c226e79202b1 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:16.307377 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Attempting to bind port c380278f-9756-427c-a730-c226e79202b1 on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:16.347104 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 46, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:16.347536 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:16.348031 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.348502 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:16.349016 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Bound port: c380278f-9756-427c-a730-c226e79202b1, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:16.349418 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.391196 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Pushing event updated for resources: {'Port': ['ID=c380278f-9756-427c-a730-c226e79202b1,revision_number=2']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:16.409714 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.410054 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.410383 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.410728 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.411029 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.411348 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.411659 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.412018 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.412351 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.412991 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.412991 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.413376 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Tracked resource versions report:
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]: pushed versions:
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]: {   'AddressGroup': {'1.2'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'ConntrackHelper': {'1.0'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Log': {'1.0'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Network': {'1.1'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Port': {'1.7'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'PortForwarding': {'1.2'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'QosPolicy': {'1.8'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SecurityGroup': {'1.4'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SecurityGroupRule': {'1.2'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'SubPort': {'1.0'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Subnet': {'1.1'},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     'Trunk': {'1.1'}}
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]: consumer versions:
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]: {   DHCP agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     HyperV agent@hv-cinder-79402: {},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     L3 agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     Metadata agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     Metering agent@dv-cinder-794021-1-iscsi: {},
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:     Open vSwitch agent@dv-cinder-794021-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'ConntrackHelper': '1.0',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Log': '1.0',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Network': '1.1',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Port': '1.7',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'PortForwarding': '1.2',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'QosPolicy': '1.8',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SecurityGroup': '1.4',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SecurityGroupRule': '1.2',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'SubPort': '1.0',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Subnet': '1.1',
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:                                                      'Trunk': '1.1'}}
Jun 01 18:47:16.414316 dv-cinder-794021-1-iscsi neutron-server[98261]:  {{(pid=98261) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 18:47:16.418649 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:16.450710 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] For port c380278f-9756-427c-a730-c226e79202b1, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:16.455202 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] For port c380278f-9756-427c-a730-c226e79202b1, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c380278f-9756-427c-a730-c226e79202b1,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:16.463201 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.470733 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:16.559156 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Pushing event updated for resources: {'Port': ['ID=c380278f-9756-427c-a730-c226e79202b1,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:16.575210 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-03c276be-16f1-4ce9-98e6-8405af1ff51f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:16.624259 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:16.627854 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce962d90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:46:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:16.678192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.745023 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.748863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59900) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:16.784678 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1d5be59-aa72-487a-aa12-dedec25c43d9 None None] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:16.813604 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bbb467c6-c559-4c19-81c9-278b8c8ef929 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:16.874935 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:16.913211 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59910) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:16.918405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-450726688-network', 'tenant_id': '518de33d604a46d0817895a23a8c49df'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:16.929349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-634aefcb-8650-4f8b-b841-79c59fffa485 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:16.935262 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:16.947930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Usage tracker for resource:network and tenant:518de33d604a46d0817895a23a8c49df is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:16.957186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:16.975834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:16.994006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Made reservation on behalf of 518de33d604a46d0817895a23a8c49df for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:16.998650 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.029390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.062513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:17.072353 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Usage tracker for resource:security_group_rule and tenant:518de33d604a46d0817895a23a8c49df is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:17.080534 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:17.097638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:17.125958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5e3f92a-adf7-40b8-b630-052c45a2db57,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:17.139254 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:17.268153 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86efa7de-6227-406c-a347-37b125c835a9 None None] Network d7df87fc-8cf1-444a-903c-77524e3d6866 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:17.286011 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Checking segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:17.286646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Network hostable DHCP agents. Network: 7c0d1d41-a033-4bad-b3c8-a15d3b31242e, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:17.329218 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce962d90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:11Z', 'revision_number': 3, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:17.335305 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02a07557-6fa1-4423-ae70-c850ae27e994 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:11Z', 'revision_number': 3, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:17.345982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.389067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:17.393451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Usage tracker for resource:security_group_rule and tenant:ebf6354753b54840970ac1734b05dcd3 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:17.397487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:17.403749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:17.404406 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:17.426830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.491521 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 7c0d1d41-a033-4bad-b3c8-a15d3b31242e) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:17.525349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.527332 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcb1266f-63ae-4cb7-9ae4-80069efc7979 None None] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:17.550079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:17.550567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.572051 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.573252 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.592878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.599868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] vlan segment allocate from pool success with {'vlan_id': 78, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:47:17.617074 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.617776 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Added segment e78afe5f-adaf-4e3b-bfd7-4e353fbcba31 of type vlan for network 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015
Jun 01 18:47:17.629427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-d5efada3-47d7-493b-989f-ef9ac42a4054', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:47:17.636306 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.677405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.689966 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7b4bb595-6332-4dda-a4a1-93389ee99560 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:17.729528 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:17.731784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=995dc8a6-5df0-4448-8488-1c21d993e3bf,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:17.763732 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:17.797877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:17.837329 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 3.6837018
Jun 01 18:47:17.842419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59930) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:17.867886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2158446-94d2-4d21-8ff2-b4b0ee2f9a14,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:17.872151 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:17.875934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.db.resource_extend [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 18:47:17.929348 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ebf6354753b54840970ac1734b05dcd3&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1787467
Jun 01 18:47:17.932233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59940) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:18.022583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.024780 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.037554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:18.039088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.094788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:18.224114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59956) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:18.244637 dv-cinder-794021-1-iscsi neutron-server[98258]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 18:47:18.247372 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 896 time: 1.3331535
Jun 01 18:47:18.264347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:18.280380 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.308939 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Pushing event updated for resources: {'Network': ['ID=999bc8ac-2cb3-4179-9c9f-b6e7a41dc015,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:18.313428 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 59964) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:18.327589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.340190 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Request body: {'subnet': {'network_id': '999bc8ac-2cb3-4179-9c9f-b6e7a41dc015', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-450726688-subnet', 'tenant_id': '518de33d604a46d0817895a23a8c49df', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:18.350201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:18.358347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:18.366859 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:47:18.383340 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Usage tracker for resource:router and tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:18.388879 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:18.391463 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59972) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:18.421929 dv-cinder-794021-1-iscsi neutron-server[98259]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 18:47:18.436050 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:18.439187 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:18.449386 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Usage tracker for resource:subnet and tenant:518de33d604a46d0817895a23a8c49df is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:18.498805 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:18.508579 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.523046 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:18.524846 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:18.551988 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2158446-94d2-4d21-8ff2-b4b0ee2f9a14,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:18.558627 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:18.569658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.571478 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.575276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.578844 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/b2158446-94d2-4d21-8ff2-b4b0ee2f9a14 HTTP/1.1" status: 204  len: 168 time: 0.6426346
Jun 01 18:47:18.578844 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Made reservation on behalf of 518de33d604a46d0817895a23a8c49df for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:18.579997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.617054 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-350d1f7c-4365-479e-be16-c81b7aaca232 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:18.617643 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-350d1f7c-4365-479e-be16-c81b7aaca232 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Synchronizing usage tracker for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:network {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:18.653851 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.692816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f899f89c-8723-4aef-8a6e-a842945083bb None None] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:18.734135 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.734816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Allocated IP 172.20.0.2 (d5efada3-47d7-493b-989f-ef9ac42a4054/3bc46f81-88af-4aba-902a-90b4633edf6a/3b3ca2a3-d92a-46d5-b858-10549997d96e) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:18.762209 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-350d1f7c-4365-479e-be16-c81b7aaca232 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Unset dirty status for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:network {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:18.763296 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-350d1f7c-4365-479e-be16-c81b7aaca232 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/networks?id=d7df87fc-8cf1-444a-903c-77524e3d6866 HTTP/1.1" status: 200  len: 812 time: 0.5360701
Jun 01 18:47:18.786700 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-1ed39766-5c22-41da-a956-15dd7e61b2ff tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/quotas/59a3ecd15231441e9ed00898e50aae60 HTTP/1.1" status: 200  len: 375 time: 0.0156085
Jun 01 18:47:18.830093 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:18.905562 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-08b67f72-2d53-4632-9414-902268ac34d0 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=59a3ecd15231441e9ed00898e50aae60&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1125717
Jun 01 18:47:19.012226 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c380278f-9756-427c-a730-c226e79202b1 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:19.052310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-05633d01-c6f6-45af-862f-493c74680db6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:19.053882 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-05633d01-c6f6-45af-862f-493c74680db6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:19.165367 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 59984) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:19.245266 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port c380278f-9756-427c-a730-c226e79202b1 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:19.256270 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port c380278f-9756-427c-a730-c226e79202b1 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:19.256838 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.294834 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.300096 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Allocated IP 172.20.0.1 (87c3456d-8d78-42d4-81e0-1f541c3dcc2f/108da5f2-bebc-4996-9e93-e596166088ad/09837b50-712b-41b5-89e5-267d9d358b31) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:19.303403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.320234 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Transition to ACTIVE for port object 3b3ca2a3-d92a-46d5-b858-10549997d96e will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:19.328876 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-05633d01-c6f6-45af-862f-493c74680db6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:19.338604 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-05633d01-c6f6-45af-862f-493c74680db6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.9456244
Jun 01 18:47:19.347287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.353213 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Transition to ACTIVE for port object 3b3ca2a3-d92a-46d5-b858-10549997d96e will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:19.353680 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1324b888-7299-40bc-9ec2-5f130804d4c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:19.391340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.404821 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:19.439731 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:19.458356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed387ab6-a6e6-48c2-9343-5badedbdfceb,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:19.463199 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-8f055b36-49c6-4870-8c70-5e94db0232d9 service neutron] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98258) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:47:19.464553 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-8f055b36-49c6-4870-8c70-5e94db0232d9 service neutron] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2718320
Jun 01 18:47:19.468940 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:19.497818 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.511303 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Allocated IP 172.27.0.202 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/e200a8c1-5a59-4731-bd93-51b68c3c45d6) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:19.514777 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:19.516280 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Usage tracker for resource:security_group_rule and tenant:9367f88780ae4c07a6fbefc972c23304 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:19.520049 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:19.526224 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Pushing event updated for resources: {'Port': ['ID=3b3ca2a3-d92a-46d5-b858-10549997d96e,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:19.528339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:19.534012 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:19.537130 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-3e34134c-d3df-437c-bfbb-0dbf27704bff tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/quotas/ab05a0b11f6c4dc5b84c7c8e30bafa9d HTTP/1.1" status: 200  len: 375 time: 0.1974571
Jun 01 18:47:19.538358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.538581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:19.586691 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:19.588341 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Checking segment: {'id': 'e78afe5f-adaf-4e3b-bfd7-4e353fbcba31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 78, 'network_id': '999bc8ac-2cb3-4179-9c9f-b6e7a41dc015'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:19.588625 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Network hostable DHCP agents. Network: 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:47:19.596204 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.624591 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port c380278f-9756-427c-a730-c226e79202b1, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c380278f-9756-427c-a730-c226e79202b1,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:19.630392 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-461aaea4-aa50-4a8d-aefb-227c5639bcb1 service neutron] 10.222.0.22 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1602306
Jun 01 18:47:19.632804 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Network 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:47:19.637218 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.668352 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:19.668622 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b032f12c-51c7-44e3-95fc-7b834ed7716c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:19.686551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:19.687216 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.709549 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87dbb48c-6896-49b9-b2c1-95e5d6715d46 None None] Network 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:19.746739 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-925c8bec-6d9b-494c-8a76-8ef8d679ee4e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1519234
Jun 01 18:47:19.766239 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 1.4460588
Jun 01 18:47:19.815663 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-511e1415-8cee-4a5a-8a66-0e9713f5ff2f service neutron] 10.222.0.22 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1767144
Jun 01 18:47:19.841760 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Attempting to bind port 3b3ca2a3-d92a-46d5-b858-10549997d96e on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:19.842202 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Attempting to bind port 3b3ca2a3-d92a-46d5-b858-10549997d96e by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:19.842490 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Attempting to bind port 3b3ca2a3-d92a-46d5-b858-10549997d96e on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:19.880414 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:19.880973 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Checking segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:19.882034 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:19.883378 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Bound using segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:19.884610 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Bound port: 3b3ca2a3-d92a-46d5-b858-10549997d96e, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:19.885069 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.013397 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60000) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:20.040149 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-88d72d35-b3aa-4f6c-98f5-f5adeb65bb47 service neutron] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:47:20.041642 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-88d72d35-b3aa-4f6c-98f5-f5adeb65bb47 service neutron] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1417766
Jun 01 18:47:20.060924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=c380278f-9756-427c-a730-c226e79202b1,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:20.071552 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.403s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:20.105323 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.122494 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63aa1695-2fcb-410f-8db5-9e40a37bd0f5 None None] Network 999bc8ac-2cb3-4179-9c9f-b6e7a41dc015 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:20.173366 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.185079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Transition to ACTIVE for port object 09837b50-712b-41b5-89e5-267d9d358b31 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:20.192977 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cf460432-8b3a-469d-b6d3-3d784379657e req-c323fb7a-2824-400a-97c9-d732354d2307 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 210 time: 0.0872607
Jun 01 18:47:20.217377 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Deleting subnet f9b3dc05-bafd-43fc-ad38-331daf8470ac {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:47:20.231118 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.259596 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] For port 3b3ca2a3-d92a-46d5-b858-10549997d96e, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:20.289598 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] For port 3b3ca2a3-d92a-46d5-b858-10549997d96e, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=3b3ca2a3-d92a-46d5-b858-10549997d96e,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:20.310001 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.319491 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.338223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.404329 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:20.453750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.474505 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.487850 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-4be91177-af1d-47ab-bb1f-697c7351ff47 service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4243832
Jun 01 18:47:20.494956 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:20.528267 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Pushing event updated for resources: {'Port': ['ID=3b3ca2a3-d92a-46d5-b858-10549997d96e,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:20.542998 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:20.588369 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=9367f88780ae4c07a6fbefc972c23304&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4024014
Jun 01 18:47:20.590009 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.591364 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.594639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60032) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:20.623358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fcb6913b-74bf-4041-acfd-2e6475a201f8,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:20.661424 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:20.668579 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.050s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:20.690647 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.701615 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:20.711776 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:20.734060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.754725 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.764369 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f9b3dc05-bafd-43fc-ad38-331daf8470ac,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:20.766422 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:20.781751 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/f9b3dc05-bafd-43fc-ad38-331daf8470ac HTTP/1.1" status: 204  len: 168 time: 0.7668006
Jun 01 18:47:20.788089 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60038) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:20.797424 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.814647 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:20.884010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:20.970573 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:20.971041 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:20.989175 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:21.003201 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:21.004059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.076296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.101907 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8c4c0058-c7ac-41e8-b426-cc781ffcb9b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:21.106387 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c380278f-9756-427c-a730-c226e79202b1 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:21.124516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcb6913b-74bf-4041-acfd-2e6475a201f8,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:21.128725 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:21.163995 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Pushing event updated for resources: {'Port': ['ID=e200a8c1-5a59-4731-bd93-51b68c3c45d6,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:21.214272 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.234328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7ff3ce65cc10>> segment before_delete 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.234685 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7ff3ce65cc10>> subnet precommit_delete_associations 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.235836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> segment_host_mapping after_create 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.235836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> port after_create 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.236069 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> port after_delete 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.236402 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> port after_update 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.237041 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> segment after_delete 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.237173 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> subnet after_create 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.238202 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> subnet after_delete 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.238462 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3ce6c7d90>> subnet after_update 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.296952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port c380278f-9756-427c-a730-c226e79202b1 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:21.297337 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.372183 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-bc7d87f2-d77d-469a-8830-e21a85740a4c service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8702090
Jun 01 18:47:21.438741 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Pushing event updated for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:21.444922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.459053 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3cd395220>> subnet after_create 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.459659 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3cd395220>> subnet after_delete 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.459931 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3cd395220>> subnet before_create 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.460255 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3cd395220>> subnet before_update 55550000 {{(pid=98258) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:21.460741 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3ce6b53a0>,) {'filters': {'network_id': ['1a1c7295-9260-4fd5-9efa-473de1975d6f']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:21.473962 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ce6b53a0>, 'b98fe0e0-d95b-4d70-8bc1-3e865ab964cd') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:21.474785 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ce6b53a0>, 'b98fe0e0-d95b-4d70-8bc1-3e865ab964cd') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:21.492264 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.497561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.829s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:21.517169 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.530302 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Releasing vlan 93 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:47:21.530697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.541392 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 3b3ca2a3-d92a-46d5-b858-10549997d96e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:21.557213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.558336 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/fcb6913b-74bf-4041-acfd-2e6475a201f8 HTTP/1.1" status: 204  len: 168 time: 0.9618640
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   from cryptography.utils import int_from_bytes
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   from cryptography.utils import int_from_bytes
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:47:21.565773 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:47:21.570088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.855s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:21.570811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:21.586749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.727752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-c6d8918b-7de5-43cb-97e4-1b46329c7f66 None None] Provisioning for port 09837b50-712b-41b5-89e5-267d9d358b31 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:21.733816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-c6d8918b-7de5-43cb-97e4-1b46329c7f66 None None] Provisioning complete for port 09837b50-712b-41b5-89e5-267d9d358b31 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:21.735013 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c6d8918b-7de5-43cb-97e4-1b46329c7f66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.810254 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4bdbb42b-2a95-40f5-abb9-ef7a86895c8c req-b26a78bd-1944-4364-b234-91bedfb4cc07 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 210 time: 0.2434771
Jun 01 18:47:21.860145 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.870775 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:21.883553 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 3b3ca2a3-d92a-46d5-b858-10549997d96e completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:21.895067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:21.905533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Pushing event deleted for resources: {'Network': ['ID=1a1c7295-9260-4fd5-9efa-473de1975d6f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:21.914571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:21.918641 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-06a17f5f-594c-49b8-91f2-f9652b01b585 admin admin] 10.222.0.22 "DELETE /v2.0/networks/1a1c7295-9260-4fd5-9efa-473de1975d6f HTTP/1.1" status: 204  len: 168 time: 1.1271317
Jun 01 18:47:21.918887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60066) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:21.968444 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-c6d8918b-7de5-43cb-97e4-1b46329c7f66 None None] Port 09837b50-712b-41b5-89e5-267d9d358b31 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:47:22.020795 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Deleting subnet ed387ab6-a6e6-48c2-9343-5badedbdfceb {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:47:22.024448 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.080381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0460c74b-7322-41dc-a087-f5bc8bc82fe4 None None] Network d5efada3-47d7-493b-989f-ef9ac42a4054 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:47:22.156621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.235444 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Provisioning for port 3b3ca2a3-d92a-46d5-b858-10549997d96e completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:22.238264 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.283851 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Provisioning complete for port 3b3ca2a3-d92a-46d5-b858-10549997d96e triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:22.284237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.357929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Allocated IP 172.27.0.7 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/f99b340a-953f-45e8-bbd2-57e0b5aa8a2b) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:22.369461 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1cd311f3-0058-46f4-bbcd-d45021e56dec req-c60489c5-c4c0-40aa-834a-b6ac095c68af tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.4713590
Jun 01 18:47:22.417418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.435091 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.574444 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.25', 53737) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:22.580210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.640100 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:22.694497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed387ab6-a6e6-48c2-9343-5badedbdfceb,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:22.719757 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.734383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:22.738929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.754370 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] 10.222.0.22 "DELETE /v2.0/subnets/ed387ab6-a6e6-48c2-9343-5badedbdfceb HTTP/1.1" status: 204  len: 168 time: 0.8340790
Jun 01 18:47:22.756792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60108) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:22.842750 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] For port 3b3ca2a3-d92a-46d5-b858-10549997d96e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=3b3ca2a3-d92a-46d5-b858-10549997d96e,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:22.866247 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:22.874365 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:22.986025 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-2f38787c-a213-45fb-b620-4fced3b5980e tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:22.987522 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-2f38787c-a213-45fb-b620-4fced3b5980e tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.25 "GET /v2.0/networks?id=d7df87fc-8cf1-444a-903c-77524e3d6866 HTTP/1.1" status: 200  len: 812 time: 0.4033902
Jun 01 18:47:23.061194 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Request body: {'port': {'device_id': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866', 'admin_state_up': True, 'tenant_id': '59a3ecd15231441e9ed00898e50aae60'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:23.110245 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Pushing event updated for resources: {'Port': ['ID=3b3ca2a3-d92a-46d5-b858-10549997d96e,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:23.124696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:23.195441 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-3e320c9e-286e-4bcb-a4e6-c8e8dd7cfaee None None] Provisioning complete for port 3b3ca2a3-d92a-46d5-b858-10549997d96e triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:23.195826 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3e320c9e-286e-4bcb-a4e6-c8e8dd7cfaee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.208329 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.220742 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904d5f84-2a6d-4b6f-ad30-78f3bd18b720 req-727a88aa-8354-41ee-8e05-6921bd9658f7 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 210 time: 0.0793996
Jun 01 18:47:23.347437 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:23.358605 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Usage tracker for resource:port and tenant:59a3ecd15231441e9ed00898e50aae60 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:23.370692 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:23.382359 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:23.409261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Made reservation on behalf of 59a3ecd15231441e9ed00898e50aae60 for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:23.417107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.429169 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.545426 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.674000 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.682174 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:23.701131 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:23.803840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Allocated IP 172.20.0.8 (d7df87fc-8cf1-444a-903c-77524e3d6866/aa5c0080-0016-4f5c-9594-aea703cda2d9/d39deb11-706c-4a8b-a636-d8d69ede4926) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:23.924973 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dc9fa000-359a-4852-bcad-932c2b98b340 req-95ec8095-faaf-4163-8788-ebadc19f13bb tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1527035
Jun 01 18:47:24.105045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.151833 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Pushing event updated for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:24.155146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.454s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:24.178944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.189969 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.25', 53743) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:24.192540 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0a874a54-1c33-4634-b7bd-d4ba6cecd8c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:24.325139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Network d7df87fc-8cf1-444a-903c-77524e3d6866 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:24.335434 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.343559 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:24.389448 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:24.407854 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.412200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7ff3cd5701c0>> segment before_delete 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.412592 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7ff3cd5701c0>> subnet precommit_delete_associations 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.413329 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> segment_host_mapping after_create 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.413672 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> port after_create 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.413991 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> port after_delete 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.414749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> port after_update 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.415082 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> segment after_delete 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.415419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> subnet after_create 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.415735 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> subnet after_delete 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.416082 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7ff3cd2365e0>> subnet after_update 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.590853 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Pushing event updated for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:24.606715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.414s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:24.631029 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:24.631667 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.686655 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-596c2b71-5220-4d29-8a49-8469477b8107 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:24.688079 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-596c2b71-5220-4d29-8a49-8469477b8107 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.4606962
Jun 01 18:47:24.690199 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6330750
Jun 01 18:47:24.706389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-cbd0c732-1ad7-45ac-a649-bfc3533341a2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:24.712146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3ccb57340>> subnet after_create 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.712712 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3ccb57340>> subnet after_delete 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.712932 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3ccb57340>> subnet before_create 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.713319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7ff3ccb57340>> subnet before_update 55550000 {{(pid=98259) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 18:47:24.713688 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7c2850>,) {'filters': {'network_id': ['999bc8ac-2cb3-4179-9c9f-b6e7a41dc015']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:24.714517 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-cbd0c732-1ad7-45ac-a649-bfc3533341a2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Synchronizing usage tracker for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:24.748321 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7c2850>, 'e78afe5f-adaf-4e3b-bfd7-4e353fbcba31') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:24.749058 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7c2850>, 'e78afe5f-adaf-4e3b-bfd7-4e353fbcba31') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:24.756571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-cbd0c732-1ad7-45ac-a649-bfc3533341a2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Unset dirty status for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:24.763649 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-cbd0c732-1ad7-45ac-a649-bfc3533341a2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 0.3211753
Jun 01 18:47:24.783926 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:24.841767 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-ecb379b9-b12b-4b20-ae71-6e6a957204d2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Synchronizing usage tracker for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:24.865240 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-ecb379b9-b12b-4b20-ae71-6e6a957204d2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Unset dirty status for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:24.878803 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-df2e4020-67cb-4dd0-8d5f-e9dd70864906 req-ecb379b9-b12b-4b20-ae71-6e6a957204d2 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1141710
Jun 01 18:47:24.901684 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4feb9f04-bde7-4add-bb75-a9fc012a5547 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:25.017815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 3b3ca2a3-d92a-46d5-b858-10549997d96e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:25.157428 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:25.158759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.166674 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Releasing vlan 78 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:47:25.167375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.194644 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 3b3ca2a3-d92a-46d5-b858-10549997d96e triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:25.195023 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.268509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   from cryptography.utils import int_from_bytes
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   from cryptography.utils import int_from_bytes
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:47:25.274436 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:47:25.316163 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:25.423471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.428192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.447558 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-265a084b-93cd-43f3-8508-118d8d4920d0 req-ee51be9e-dfcc-49e1-abb5-75b8c74e3f54 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1718416
Jun 01 18:47:25.587320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Pushing event updated for resources: {'Port': ['ID=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:25.602249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:25.647369 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:25.665475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:25.793882 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.892s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:25.908491 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] 10.222.0.22 "DELETE /v2.0/networks/999bc8ac-2cb3-4179-9c9f-b6e7a41dc015 HTTP/1.1" status: 204  len: 168 time: 3.0319438
Jun 01 18:47:25.909164 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.388s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:25.970450 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Pushing event deleted for resources: {'Network': ['ID=999bc8ac-2cb3-4179-9c9f-b6e7a41dc015,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:26.001472 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-fe8dc64d-5a25-40db-9c85-11f272a06bfc None None] Provisioning complete for port 09837b50-712b-41b5-89e5-267d9d358b31 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:26.001855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-fe8dc64d-5a25-40db-9c85-11f272a06bfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.007403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:26.071972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-fe8dc64d-5a25-40db-9c85-11f272a06bfc None None] Port 09837b50-712b-41b5-89e5-267d9d358b31 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:47:26.183099 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2528fa90-69a5-4c31-905b-565c31fbca42 req-f676ffcc-9f8d-4a5d-a593-1c7cde4243b8 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:26.185328 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2528fa90-69a5-4c31-905b-565c31fbca42 req-f676ffcc-9f8d-4a5d-a593-1c7cde4243b8 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 0.1345751
Jun 01 18:47:26.233273 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60210) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:26.293065 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2528fa90-69a5-4c31-905b-565c31fbca42 req-24b858ae-d1be-4709-b920-e28ae041075a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1018221
Jun 01 18:47:26.316618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:47:26.387237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:47:26.493140 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b63157d9-7d14-43ce-9d9c-ce2ad91437e6 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=c9d468526c1c413d84fd0bdf81022e86&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2545180
Jun 01 18:47:26.494579 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60214) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:26.573011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.614542 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.648964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.678090 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.683183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:26.699707 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d1b483f-12a6-4bca-8c44-748d71e4ad40,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:26.703176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:26.705648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:26.706855 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/5d1b483f-12a6-4bca-8c44-748d71e4ad40 HTTP/1.1" status: 204  len: 168 time: 0.2112989
Jun 01 18:47:27.059070 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-62fca3bb-1026-4ecc-9c71-b3df4e85fdc7 req-c25b1c65-e115-42d1-8110-c036dee32f23 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.4135795
Jun 01 18:47:27.094581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:27.217848 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:27.255046 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:27.259358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b2e0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:27.297947 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:27.309356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:27.310510 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:27.311118 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-742c8cb7-5c08-4f4a-9fef-69973e035b8f admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 12.1608598
Jun 01 18:47:27.313474 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60240) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:27.321516 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] 10.222.0.22 "PUT /v2.0/routers/e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2/add_router_interface HTTP/1.1" status: 200  len: 503 time: 12.6180887
Jun 01 18:47:27.369837 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:27.373170 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d4c0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:27.476212 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60246) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:27.618462 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d87de55d-4962-43fe-a311-c400dc07f6d2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=518de33d604a46d0817895a23a8c49df&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1402979
Jun 01 18:47:27.622349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60250) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:27.793677 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:27.809866 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:27.920800 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:28.227792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Router efd33295-fb61-4e57-afa9-48097bd6e639 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:47:28.357395 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:28.398762 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247659a0-242e-47a7-ae8d-ba997b552a7c req-4d7902bf-5fac-4b51-812a-2b0cb7469194 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:28.400900 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-247659a0-242e-47a7-ae8d-ba997b552a7c req-4d7902bf-5fac-4b51-812a-2b0cb7469194 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 0.3728034
Jun 01 18:47:28.411090 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d4c0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:23Z', 'revision_number': 2, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:28.421889 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:28.422248 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Updating router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 port 09837b50-712b-41b5-89e5-267d9d358b31 binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:28.431464 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b2e0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 3, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:28.436490 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:28.438779 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Updating router 30c62078-57a9-4e7d-a9a5-da5b56adb64d port e200a8c1-5a59-4731-bd93-51b68c3c45d6 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:28.470005 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-247659a0-242e-47a7-ae8d-ba997b552a7c req-73c06221-3a4b-4ff5-b27e-eda5955aefb9 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525792
Jun 01 18:47:28.587169 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:28.618892 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:28.746296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:28.755798 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:28.805598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:28.810653 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 10.9670348
Jun 01 18:47:28.811534 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60270) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:28.847471 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Sync routers for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:28.884914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:28.886269 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaefdc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:28.976466 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c3275e00-7f42-4bff-9fa0-949e0e3c43e3 req-8f2161d7-9ab5-4db3-8fed-10faf316ace6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1585538
Jun 01 18:47:29.105351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60274) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:29.110247 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group': {'name': 'tempest-securitygroup--504874190', 'description': 'tempest-description--124816673'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:29.116984 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:29.121709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:29.124694 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:29.131057 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:29.148653 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.173515 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.175377 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.428542 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.450997 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Transition to ACTIVE for port object e200a8c1-5a59-4731-bd93-51b68c3c45d6 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:29.490007 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:29.501354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:29.504127 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:29.510812 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:29.595411 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.596873 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.605002 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Allocated IP 172.20.0.1 (d5efada3-47d7-493b-989f-ef9ac42a4054/3bc46f81-88af-4aba-902a-90b4633edf6a/7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:29.607497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:29.618671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.631502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=995dc8a6-5df0-4448-8488-1c21d993e3bf,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:29.639639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:29.642699 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:29.655695 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.683885 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Transition to ACTIVE for port object 09837b50-712b-41b5-89e5-267d9d358b31 will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:29.702405 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:29.711737 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:29.807034 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Attempting to bind port e200a8c1-5a59-4731-bd93-51b68c3c45d6 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:29.807475 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Attempting to bind port e200a8c1-5a59-4731-bd93-51b68c3c45d6 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:29.807835 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Attempting to bind port e200a8c1-5a59-4731-bd93-51b68c3c45d6 on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:29.822551 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:29.843347 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Pushing event updated for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:29.863458 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:29.965253 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:30.016240 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:30.016703 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:30.017128 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.017546 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:30.018063 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Bound port: e200a8c1-5a59-4731-bd93-51b68c3c45d6, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:30.018451 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.053066 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.054552 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/995dc8a6-5df0-4448-8488-1c21d993e3bf HTTP/1.1" status: 204  len: 168 time: 2.4212232
Jun 01 18:47:30.090965 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.096798 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.9903831
Jun 01 18:47:30.099535 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60286) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:30.141722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group_rule': {'security_group_id': 'b96674db-5c6a-422e-ae72-a439a68bf41a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:30.150194 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:30.150405 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Attempting to bind port 09837b50-712b-41b5-89e5-267d9d358b31 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:30.150898 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Attempting to bind port 09837b50-712b-41b5-89e5-267d9d358b31 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:30.151268 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Attempting to bind port 09837b50-712b-41b5-89e5-267d9d358b31 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:30.154871 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:30.158048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:30.165274 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:30.168883 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:30.170449 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Checking segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:30.174128 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.174554 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Bound using segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:30.230250 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Bound port: 09837b50-712b-41b5-89e5-267d9d358b31, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:30.230250 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.231649 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.274086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Pushing event updated for resources: {'Port': ['ID=e200a8c1-5a59-4731-bd93-51b68c3c45d6,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:30.310471 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.668s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:30.354026 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b96674db-5c6a-422e-ae72-a439a68bf41a,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:30.458450 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] For port 09837b50-712b-41b5-89e5-267d9d358b31, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:30.463171 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] For port 09837b50-712b-41b5-89e5-267d9d358b31, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=09837b50-712b-41b5-89e5-267d9d358b31,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:30.476290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.511s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:30.479972 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.484033 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.486736 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:30.495341 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.503970 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.524109 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] For port e200a8c1-5a59-4731-bd93-51b68c3c45d6, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:30.524722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:30.537395 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Transition to ACTIVE for port object 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:30.560932 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c5f506c3-5148-43c6-bf9d-de28a1734408 req-f135c430-de51-4e66-b385-f40369e03020 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1821477
Jun 01 18:47:30.562955 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb71c476-82a8-4690-9b72-3e9b9e726fbd,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:30.573323 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:30.582376 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc55d846-5358-402d-9e7b-6f2d907b587d req-35742e8b-5dc4-4c7a-bac2-e5cc14f88b99 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:30.584334 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-fc55d846-5358-402d-9e7b-6f2d907b587d req-35742e8b-5dc4-4c7a-bac2-e5cc14f88b99 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 0.9110699
Jun 01 18:47:30.587259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.588802 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4699273
Jun 01 18:47:30.592402 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60294) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:30.599614 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group_rule': {'security_group_id': 'b96674db-5c6a-422e-ae72-a439a68bf41a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:30.610933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:30.662222 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] For port e200a8c1-5a59-4731-bd93-51b68c3c45d6, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e200a8c1-5a59-4731-bd93-51b68c3c45d6,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:30.665577 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:30.670262 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:30.678183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:30.703823 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.726757 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:30.728574 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d4c0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:30.734767 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a60611a5-4fcf-4dc5-89e6-3b3a1237a704 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:30.755086 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.836900 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-fc55d846-5358-402d-9e7b-6f2d907b587d req-96a60c76-6e6f-4e58-9beb-9c248269e1a7 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2269664
Jun 01 18:47:30.850926 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Pushing event updated for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=4']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:30.855177 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.863783 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:30.865911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d0fcc17c-5846-4d75-af3a-e6b1188f347a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:30.949681 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Pushing event updated for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:30.951916 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:30.961517 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.979364 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:30.998674 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:30.999578 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b2e0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:31.003745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:31.010158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:31.011817 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:31.015226 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:31.108707 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Pushing event updated for resources: {'Port': ['ID=e200a8c1-5a59-4731-bd93-51b68c3c45d6,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:31.136231 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.401s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:31.153797 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ed0263a8-66bf-4120-a140-edc0b138974b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:31.165980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:31.277646 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:31.420670 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:31.503163 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaefdc0>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:26Z', 'revision_number': 3, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:31.533204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b39072b8-b260-4971-a623-3a6ab08e585b,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:31.545142 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.396s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:31.559673 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:31.560907 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.9672968
Jun 01 18:47:31.563770 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60314) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:31.568584 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:31.578867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:31.586684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:floatingip and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:31.594622 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Allocated IP 172.20.0.1 (7c0d1d41-a033-4bad-b3c8-a15d3b31242e/e5e3f92a-adf7-40b8-b630-052c45a2db57/969881a4-e1be-405f-8d2a-24f457975526) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:31.626368 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Checking router: efd33295-fb61-4e57-afa9-48097bd6e639 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:31.626950 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Updating router efd33295-fb61-4e57-afa9-48097bd6e639 port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:31.642992 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:31.661341 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-def23915-bd95-4507-87a6-b1a30e20baa0 None None] Provisioning for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:31.671234 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-def23915-bd95-4507-87a6-b1a30e20baa0 None None] Provisioning complete for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:31.671613 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-def23915-bd95-4507-87a6-b1a30e20baa0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:31.713139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:31.797854 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:31.907767 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-def23915-bd95-4507-87a6-b1a30e20baa0 None None] Port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:47:31.911412 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:32.124559 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:32.233933 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d4c0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:30Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:32.245141 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0524d832-cb20-47ca-9130-6f56926d44b5 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:30Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:32.369830 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f04bf10b-7844-4583-976a-c2cdf56c8c44 req-ea7ccbe8-4509-4b10-b315-9f2992795325 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1875010
Jun 01 18:47:32.400666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:32.442002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:32.493002 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Request body: {'port': {'device_id': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'admin_state_up': True, 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:32.544354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-5be8ecba-55d1-43df-97b8-3c276303e08a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98258) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:47:32.545388 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-5be8ecba-55d1-43df-97b8-3c276303e08a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1174235
Jun 01 18:47:32.796259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:32.797379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:32.800904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:32.823156 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:32.914849 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Pushing event updated for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:32.937786 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.504s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:32.996148 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.185223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.200018 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Transition to ACTIVE for port object f99b340a-953f-45e8-bbd2-57e0b5aa8a2b will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:33.211823 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 09837b50-712b-41b5-89e5-267d9d358b31 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:33.381396 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f91ac3a-f86b-4e98-8ce5-3a210c07d8bd req-83430bd5-e87e-495b-b762-a6e0dc5fb4fd tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:33.389119 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f91ac3a-f86b-4e98-8ce5-3a210c07d8bd req-83430bd5-e87e-495b-b762-a6e0dc5fb4fd tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 1.2124386
Jun 01 18:47:33.410697 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.416004 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:33.448032 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.486857 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:33.633999 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Attempting to bind port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:33.634595 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Attempting to bind port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:33.635513 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Attempting to bind port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:33.674209 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Usage tracker for resource:port and tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:33.725046 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:33.734339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:33.734339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:33.736174 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.738927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:33.739352 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Bound port: f99b340a-953f-45e8-bbd2-57e0b5aa8a2b, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:33.740405 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:33.771581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Request body: {'port': {'device_id': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:33.882944 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d5ddf300-7ada-40d6-94e8-13b3aea60f68 req-fa03b067-f083-475e-acfb-6c8a34c61bdd tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1082978
Jun 01 18:47:33.924321 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b2e0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 3, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:33.929179 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:33.942384 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Pushing event updated for resources: {'Port': ['ID=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:33.970461 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.483s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:33.971086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 09837b50-712b-41b5-89e5-267d9d358b31 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:33.975701 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f91ac3a-f86b-4e98-8ce5-3a210c07d8bd req-3d76ce9d-38c8-4fa7-abdc-9985ac82d054 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5855327
Jun 01 18:47:33.987901 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9905b1a2-9994-40ad-b832-12268dba7302 None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 3, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:34.023326 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 09837b50-712b-41b5-89e5-267d9d358b31 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:34.023784 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.050673 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.073411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.138930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aac50b90-ab54-48bb-a65d-127a1382ab92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:34.255151 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] For port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:34.285517 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] For port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:34.297805 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.308372 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:34.320686 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Pushing event updated for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:34.332940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:34.375176 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.560583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.669089 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.696690 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:34.801592 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:34.804962 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:34.806729 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaefdc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:34.819330 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:35.030213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:35.048919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:35.275330 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:35.426295 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60406) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:35.510015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Router efd33295-fb61-4e57-afa9-48097bd6e639 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:47:35.521990 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-39e9345d-ccde-42b0-b934-d5aa16d38177 req-6ba010d6-c01d-4fcc-a42f-3c20e5450583 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.0671043
Jun 01 18:47:35.613356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Allocated IP 172.20.0.5 (2bc7607a-0e83-4423-b9b7-ac3e13607a13/b40008fb-ef5f-4ddd-be90-93c9dd2d5423/7a59828a-57a1-4f2b-9392-36cb6d568256) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:35.759115 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 09837b50-712b-41b5-89e5-267d9d358b31, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=09837b50-712b-41b5-89e5-267d9d358b31,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:35.804471 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:35.845237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:35.873481 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Pushing event updated for resources: {'Port': ['ID=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:35.873691 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] 10.222.0.22 "PUT /v2.0/routers/efd33295-fb61-4e57-afa9-48097bd6e639/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.0568874
Jun 01 18:47:35.873789 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.563s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:35.873789 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.061s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:35.939655 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:35.948814 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:35.952076 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:35.965995 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaefdc0>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '969881a4-e1be-405f-8d2a-24f457975526', 'name': '', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'mac_address': 'fa:16:3e:e5:51:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_interface', 'standard_attr_id': 113, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:31Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 2, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'subnets': [{'id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:35.970032 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c34fc0e2-8d38-474c-b152-ef0d8b854156 None None] The sync data for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi is: [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '969881a4-e1be-405f-8d2a-24f457975526', 'name': '', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'mac_address': 'fa:16:3e:e5:51:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_interface', 'standard_attr_id': 113, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:31Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 2, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'subnets': [{'id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:35.984779 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.010351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Allocated IP 172.27.0.22 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/82098b46-2a19-46bd-be09-02a3c2d6d83e) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:36.063676 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.065805 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.164069 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:36.214295 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.221907 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:47:36.350777 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e200a8c1-5a59-4731-bd93-51b68c3c45d6 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:36.577228 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port e200a8c1-5a59-4731-bd93-51b68c3c45d6 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:36.584755 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port e200a8c1-5a59-4731-bd93-51b68c3c45d6 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:36.585140 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.662009 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.745443 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Pushing event updated for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:36.881315 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.914909 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:36.919042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Usage tracker for resource:security_group_rule and tenant:629653e7a56f4f10b1e5b7d54a6310b4 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:36.922353 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:36.926928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port e200a8c1-5a59-4731-bd93-51b68c3c45d6, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e200a8c1-5a59-4731-bd93-51b68c3c45d6,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:36.929238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:36.941798 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:36.945124 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:37.077315 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=e200a8c1-5a59-4731-bd93-51b68c3c45d6,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:37.083860 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:37.135356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-ca601dae-b474-4c97-8655-aaf074006f32 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:37.136149 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-ca601dae-b474-4c97-8655-aaf074006f32 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:37.180871 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-ca601dae-b474-4c97-8655-aaf074006f32 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:37.181697 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-ca601dae-b474-4c97-8655-aaf074006f32 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 819 time: 0.2716858
Jun 01 18:47:37.199831 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-f0c1418c-627c-44eb-93d7-28327173a2b2 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/quotas/25a97ba1c3dd49d0bba7b78bbfa71df1 HTTP/1.1" status: 200  len: 375 time: 0.0109158
Jun 01 18:47:37.233915 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:37.253375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:37.258599 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.db.resource_extend [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 18:47:37.282823 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:37.300678 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-b230bb4c-86db-4707-b6e3-7fd37e6fdb53 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:37.315838 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event updated for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:37.321736 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-b230bb4c-86db-4707-b6e3-7fd37e6fdb53 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:37.323297 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-b230bb4c-86db-4707-b6e3-7fd37e6fdb53 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1179767
Jun 01 18:47:37.330078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.367263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.203s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:37.376230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.004s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:37.376556 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:37.399583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.434314 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01f6aea-b69a-4745-8e0b-75a4ac758def req-7beb9ac7-4233-4645-a5e3-a6ac26c4bb41 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:37.435862 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b01f6aea-b69a-4745-8e0b-75a4ac758def req-7beb9ac7-4233-4645-a5e3-a6ac26c4bb41 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 931 time: 2.0121379
Jun 01 18:47:37.447349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5093e90c-9d02-4454-bb65-72c2d234d56d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:37.466862 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-8af66c93-bf81-4cf4-a98b-06b410136b9c service neutron] 10.222.0.22 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1347377
Jun 01 18:47:37.621702 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d39deb11-706c-4a8b-a636-d8d69ede4926 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:37.629050 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-f8d4d31a-66c7-4b0b-a9a8-ebc093b3aca0 service neutron] 10.222.0.22 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1556437
Jun 01 18:47:37.636173 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.651590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:37.657361 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:37.657971 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.662889 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.672336 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=629653e7a56f4f10b1e5b7d54a6310b4&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6983795
Jun 01 18:47:37.673306 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:37.678331 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60440) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:37.681363 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa1821cf-c140-433c-b425-fe11b443a520,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:37.705222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:37.789188 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.802260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Transition to ACTIVE for port object d39deb11-706c-4a8b-a636-d8d69ede4926 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:37.826522 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b01f6aea-b69a-4745-8e0b-75a4ac758def req-711f640a-1d92-4a47-bb1f-41c240974f6f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3689163
Jun 01 18:47:37.837312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.841896 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.885445 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:37.956770 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:37.963611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a7b1b65d-9e94-4c68-a6fb-ed7392880d08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:37.989554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa1821cf-c140-433c-b425-fe11b443a520,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:37.999572 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:38.003649 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 5.5465295
Jun 01 18:47:38.054213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Request body: {'port': {'device_id': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:38.058483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.068574 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/fa1821cf-c140-433c-b425-fe11b443a520 HTTP/1.1" status: 204  len: 168 time: 0.3853278
Jun 01 18:47:38.097789 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-c48efd95-7e33-4ee1-a934-ebefe3423380 None None] Provisioning complete for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:38.098325 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c48efd95-7e33-4ee1-a934-ebefe3423380 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.188660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aabf36b-ed1d-494b-b930-7cecd6461457 req-83be9119-72b0-4944-a07a-26323b653e91 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:38.190207 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4aabf36b-ed1d-494b-b930-7cecd6461457 req-83be9119-72b0-4944-a07a-26323b653e91 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 931 time: 0.2074068
Jun 01 18:47:38.206712 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e200a8c1-5a59-4731-bd93-51b68c3c45d6 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:38.276664 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-4aabf36b-ed1d-494b-b930-7cecd6461457 req-c150f496-c73c-4e45-9175-2aeb8f0cc908 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:38.284245 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-c48efd95-7e33-4ee1-a934-ebefe3423380 None None] Port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:47:38.307443 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-4aabf36b-ed1d-494b-b930-7cecd6461457 req-c150f496-c73c-4e45-9175-2aeb8f0cc908 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:38.308764 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4aabf36b-ed1d-494b-b930-7cecd6461457 req-c150f496-c73c-4e45-9175-2aeb8f0cc908 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1119931
Jun 01 18:47:38.311723 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port e200a8c1-5a59-4731-bd93-51b68c3c45d6 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:38.312059 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.413909 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7bebb652-2b57-4200-90c3-753e881fab05 req-6013f1a7-dd0e-41e0-9fd2-8a04d200379f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 210 time: 0.3977597
Jun 01 18:47:38.453157 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.454183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Pushing event updated for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:38.506522 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device f99b340a-953f-45e8-bbd2-57e0b5aa8a2b up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:38.510700 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.625s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:38.511190 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:38.573752 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60464) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:38.597623 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:38.604611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.604916 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:38.605274 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.653714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:38.665470 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Usage tracker for resource:security_group_rule and tenant:ae652cd89a30444ea5760014a3e4ea07 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:38.674089 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:38.674708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:38.686327 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:47:38.686533 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:38.691663 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:38.705726 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:38.750497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=82098b46-2a19-46bd-be09-02a3c2d6d83e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:38.758845 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.774860 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:38.863062 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.889790 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:38.898583 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.899780 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 09837b50-712b-41b5-89e5-267d9d358b31 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:38.949804 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Attempting to bind port d39deb11-706c-4a8b-a636-d8d69ede4926 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:38.950522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Attempting to bind port d39deb11-706c-4a8b-a636-d8d69ede4926 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'ade580c3-c29b-43be-bce2-a56993c1cb04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 52, 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:38.951097 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Attempting to bind port d39deb11-706c-4a8b-a636-d8d69ede4926 on network d7df87fc-8cf1-444a-903c-77524e3d6866 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:38.968039 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:38.974185 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:38.987489 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Port d39deb11-706c-4a8b-a636-d8d69ede4926 on network d7df87fc-8cf1-444a-903c-77524e3d6866 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:47:38.988111 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Attempting to bind port d39deb11-706c-4a8b-a636-d8d69ede4926 on network d7df87fc-8cf1-444a-903c-77524e3d6866 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:38.994582 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.026837 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:39.027510 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Checking segment: {'id': 'ade580c3-c29b-43be-bce2-a56993c1cb04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 52, 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:39.028275 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Bound using segment: {'id': 'ade580c3-c29b-43be-bce2-a56993c1cb04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 52, 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:39.028973 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Bound port: d39deb11-706c-4a8b-a636-d8d69ede4926, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ade580c3-c29b-43be-bce2-a56993c1cb04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 52, 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:39.029550 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.034482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a27acbcd-ae37-4091-a406-4ba3ad4f472a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:39.071733 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:39.075953 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:39.108847 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.164821 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f246f5d-f611-47cd-9cae-0d02f19fc3c0,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:39.180800 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:39.191433 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ae652cd89a30444ea5760014a3e4ea07&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6161802
Jun 01 18:47:39.201099 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-b2ebce91-f024-4e61-a3c7-584322fe8424 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:39.204393 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-b2ebce91-f024-4e61-a3c7-584322fe8424 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 819 time: 0.3910460
Jun 01 18:47:39.205146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60488) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:39.205809 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 09837b50-712b-41b5-89e5-267d9d358b31 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:39.206203 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.247269 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-e8684fb0-690d-4bf5-bdbb-941cd020797b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/quotas/25a97ba1c3dd49d0bba7b78bbfa71df1 HTTP/1.1" status: 200  len: 375 time: 0.0278010
Jun 01 18:47:39.403607 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.429830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:47:39.437575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.448067 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:39.456075 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.468221 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:39.473699 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7f1670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:39.486331 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1284a503-857b-4c05-aad9-41b82d2e676b admin admin] 10.222.0.22 "PUT /v2.0/routers/30c62078-57a9-4e7d-a9a5-da5b56adb64d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 12.1716220
Jun 01 18:47:39.598284 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-f76c9357-61bf-4581-8343-b813ec2c8c56 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3058817
Jun 01 18:47:39.625731 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:39.664357 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.686963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:39.715576 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.25', 53764) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:39.727637 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f246f5d-f611-47cd-9cae-0d02f19fc3c0,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:39.733800 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:39.745239 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=d39deb11-706c-4a8b-a636-d8d69ede4926,segment=NetworkSegment(ade580c3-c29b-43be-bce2-a56993c1cb04),segment_id=ade580c3-c29b-43be-bce2-a56993c1cb04)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:39.806631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.815172 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Sync routers for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:47:39.830602 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:39.831249 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd72c850>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:39.848257 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.924935 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:39.929276 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/4f246f5d-f611-47cd-9cae-0d02f19fc3c0 HTTP/1.1" status: 204  len: 168 time: 0.7201359
Jun 01 18:47:39.941436 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:40.007124 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-ead93bcc-97a9-490f-ab95-d18823f31a6d service neutron] 10.222.0.22 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3974059
Jun 01 18:47:40.012906 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:40.051091 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device f99b340a-953f-45e8-bbd2-57e0b5aa8a2b up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:40.222338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Pushing event updated for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:40.239015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:40.248020 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c813252-6d7b-4d14-8723-ed53f02a7a07 req-48da6598-93db-43de-b317-f3af04d07fae tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:40.250453 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2c813252-6d7b-4d14-8723-ed53f02a7a07 req-48da6598-93db-43de-b317-f3af04d07fae tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 1.1464090
Jun 01 18:47:40.318558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:40.319317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:40.321344 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] 10.222.0.25 "PUT /v2.0/ports/d39deb11-706c-4a8b-a636-d8d69ede4926 HTTP/1.1" status: 200  len: 1093 time: 7.1096423
Jun 01 18:47:40.325347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:47:40.489381 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.db.resource_extend [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 18:47:40.519014 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-b39045b5-a773-4692-8074-ffe80d5f1cc4 service neutron] 10.222.0.22 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5107338
Jun 01 18:47:40.530618 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-0d7eb24c-6318-4fb3-bc3d-e65be6aef7b0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:40.532153 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-0d7eb24c-6318-4fb3-bc3d-e65be6aef7b0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 819 time: 0.8095100
Jun 01 18:47:40.554763 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:40.555275 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:40.584664 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2c813252-6d7b-4d14-8723-ed53f02a7a07 req-17446f94-be34-4006-93f5-d41951fde930 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3119900
Jun 01 18:47:40.600350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Request body: {'port': {'device_id': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'admin_state_up': True, 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:40.606109 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:40.663755 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7f1670>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 2, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:40.673941 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:40.674321 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Updating router 30c62078-57a9-4e7d-a9a5-da5b56adb64d port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:40.745329 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8966588-283f-4af8-bad8-723876420f68" -d '{"events": [{"name": "network-changed", "server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:47:40.856996 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:40.902171 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:40.925486 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7a59828a-57a1-4f2b-9392-36cb6d568256 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:40.943079 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:40.969853 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.177570 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:41.284013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=82098b46-2a19-46bd-be09-02a3c2d6d83e,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:41.305713 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:41.367885 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Transition to ACTIVE for port object 7a59828a-57a1-4f2b-9392-36cb6d568256 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:41.386279 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-352a18b5-27a9-45ef-9017-f13744856337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:41.387923 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-352a18b5-27a9-45ef-9017-f13744856337 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=59a3ecd15231441e9ed00898e50aae60&device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 1096 time: 0.9716003
Jun 01 18:47:41.407597 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.495234 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.502581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:41.506997 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Transition to ACTIVE for port object 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:41.519987 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.526375 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:41.558049 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-035d95f7-1250-48e7-abfb-c65bde9ad593 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d39deb11-706c-4a8b-a636-d8d69ede4926 HTTP/1.1" status: 200  len: 217 time: 0.1594398
Jun 01 18:47:41.604359 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd72c850>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '969881a4-e1be-405f-8d2a-24f457975526', 'name': '', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'mac_address': 'fa:16:3e:e5:51:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_interface', 'standard_attr_id': 113, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:31Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 2, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'subnets': [{'id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:41.607948 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:41.615807 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Checking router: efd33295-fb61-4e57-afa9-48097bd6e639 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:47:41.616175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Updating router efd33295-fb61-4e57-afa9-48097bd6e639 port 969881a4-e1be-405f-8d2a-24f457975526 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:47:41.681847 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31838de-df93-4085-a95f-3070736ae6fd None None] Pushing event updated for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:41.691703 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a31838de-df93-4085-a95f-3070736ae6fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:41.734288 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.750621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.808713 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169968e0-8c73-4a13-abc2-38ab6f42ecf3 req-694e01a5-f286-4ef4-93a1-0562e2abb1c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:41.831463 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-169968e0-8c73-4a13-abc2-38ab6f42ecf3 req-694e01a5-f286-4ef4-93a1-0562e2abb1c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:41.869594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:41.872664 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 10.3079307
Jun 01 18:47:41.900374 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60570) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:41.913538 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:41.938069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1467507370', 'description': 'tempest-description--993253263'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:41.939660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Pushing event updated for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:41.945784 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:41.950510 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:41.960857 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:41.968992 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:41.990351 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.032098 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:42.041445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:42.054287 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:42.062478 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.560s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:42.071550 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:42.127911 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Attempting to bind port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:42.128533 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Attempting to bind port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:42.129087 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Attempting to bind port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:42.135738 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:42.139356 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Checking segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:42.141003 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.142615 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Bound using segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:42.145295 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Bound port: 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:42.147755 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.158204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-169968e0-8c73-4a13-abc2-38ab6f42ecf3 req-694e01a5-f286-4ef4-93a1-0562e2abb1c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:42.160799 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-169968e0-8c73-4a13-abc2-38ab6f42ecf3 req-694e01a5-f286-4ef4-93a1-0562e2abb1c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 931 time: 1.2225800
Jun 01 18:47:42.164356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Made reservation on behalf of 25a97ba1c3dd49d0bba7b78bbfa71df1 for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:42.171025 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.246182 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.255207 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.268050 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:42.325957 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] For port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:42.332403 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] For port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:42.349422 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.354969 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d9e249d0-daec-40d3-8b1c-207330b726e0,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:42.362989 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:42.374608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.376271 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4685500
Jun 01 18:47:42.377487 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:42.379124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60584) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:42.385710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group_rule': {'security_group_id': 'd9e249d0-daec-40d3-8b1c-207330b726e0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:42.417378 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:42.425963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:42.433585 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:42.446455 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:42.447401 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.461384 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Transition to ACTIVE for port object 969881a4-e1be-405f-8d2a-24f457975526 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:42.474217 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.483197 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:42.484474 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.510710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:47:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2a29c4d-ff3f-4100-955b-4dcd30ce2eeb x-openstack-request-id: req-d2a29c4d-ff3f-4100-955b-4dcd30ce2eeb {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:47:42.511618 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:47:42.512034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d2a29c4d-ff3f-4100-955b-4dcd30ce2eeb {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:47:42.512704 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926', 'status': 'completed', 'code': 200}
Jun 01 18:47:42.528309 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-169968e0-8c73-4a13-abc2-38ab6f42ecf3 req-6f0dc7be-add1-43a4-9679-74ca7c71db75 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3226876
Jun 01 18:47:42.559608 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31838de-df93-4085-a95f-3070736ae6fd None None] Pushing event updated for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=4']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:42.579423 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a31838de-df93-4085-a95f-3070736ae6fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:42.586652 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:42.589545 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7f1670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:42.595380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Attempting to bind port 7a59828a-57a1-4f2b-9392-36cb6d568256 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:42.602402 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Attempting to bind port 7a59828a-57a1-4f2b-9392-36cb6d568256 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:42.603143 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Attempting to bind port 7a59828a-57a1-4f2b-9392-36cb6d568256 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:42.623948 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Port 7a59828a-57a1-4f2b-9392-36cb6d568256 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:47:42.630946 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Attempting to bind port 7a59828a-57a1-4f2b-9392-36cb6d568256 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:42.659161 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:42.660913 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Checking segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:42.664298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Bound using segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:42.665010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Bound port: 7a59828a-57a1-4f2b-9392-36cb6d568256, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:42.665558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.714919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.729531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.733292 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:42.763198 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2eecde40-cf4b-4ef6-943b-324d788ddbfb,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:42.812490 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:42.858098 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:42.859534 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4775193
Jun 01 18:47:42.866235 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:42.868712 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60598) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:42.869982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=7a59828a-57a1-4f2b-9392-36cb6d568256,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:42.880192 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a2383f2a-9f2b-4899-b938-631451e8d75b req-5ac99762-959c-4f9e-8b47-fdc56ace405f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 210 time: 0.0722103
Jun 01 18:47:42.897179 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group_rule': {'security_group_id': 'd9e249d0-daec-40d3-8b1c-207330b726e0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:42.921197 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:42.931036 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Allocated IP 172.20.0.7 (7c0d1d41-a033-4bad-b3c8-a15d3b31242e/e5e3f92a-adf7-40b8-b630-052c45a2db57/b54280f9-3b4c-49b4-b5a4-610e3328b1af) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:42.939728 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:42.943533 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:42.950785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:42.978945 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.005697 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Pushing event updated for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:43.017382 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.530s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:43.048890 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Attempting to bind port 969881a4-e1be-405f-8d2a-24f457975526 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:43.049462 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Attempting to bind port 969881a4-e1be-405f-8d2a-24f457975526 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:43.049623 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Attempting to bind port 969881a4-e1be-405f-8d2a-24f457975526 on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:43.052902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.054612 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:43.068090 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:43.068495 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Checking segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:43.068904 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.069334 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Bound using segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:43.069784 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Bound port: 969881a4-e1be-405f-8d2a-24f457975526, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:43.070166 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.106849 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-8aa9c8f5-f897-48f6-9cb0-614f3631f627 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-securitygroup--504874190&fields=id&tenant_id=e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 267 time: 0.0604677
Jun 01 18:47:43.116111 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:43.264766 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] For port 969881a4-e1be-405f-8d2a-24f457975526, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:43.269500 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-61874011-5a0f-462f-afb9-247d04baee75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:43.269969 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] For port 969881a4-e1be-405f-8d2a-24f457975526, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=969881a4-e1be-405f-8d2a-24f457975526,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:43.271751 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-61874011-5a0f-462f-afb9-247d04baee75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 810 time: 0.1640501
Jun 01 18:47:43.277442 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.292677 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:43.305097 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.314228 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.315676 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-7136afa2-bed1-45ff-a6c1-34557ed55656 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/quotas/e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 375 time: 0.0344160
Jun 01 18:47:43.317191 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:43.437536 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:43.438168 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.439602 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] 10.222.0.25 "PUT /v2.0/ports/7a59828a-57a1-4f2b-9392-36cb6d568256 HTTP/1.1" status: 200  len: 1093 time: 5.4158313
Jun 01 18:47:43.456966 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:47:43.457636 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd72c850>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:47:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:43.463352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19595e0d-12ff-4b8d-9536-7c2eaa087592,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:43.464645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Pushing event updated for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:43.473994 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:43.474593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.477339 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.361s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:43.479096 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60624) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:43.479313 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f6f1d400-faab-44cb-a2b5-743c787e8d96 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5865769
Jun 01 18:47:43.534091 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-84130741-bb50-4636-b8a8-34348311b9cd req-f1c4ff68-36b7-4771-adfb-6a1c112913b8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:43.537388 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce7f1670>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:42Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:43.542899 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db2922df-ce56-47c8-9dcf-715504701606 None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:42Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:43.548916 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:43.556659 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:43.564937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-84130741-bb50-4636-b8a8-34348311b9cd req-f1c4ff68-36b7-4771-adfb-6a1c112913b8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:43.568632 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Pushing event updated for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:43.570328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:floatingip and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:43.574783 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:43.583310 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-f1c4ff68-36b7-4771-adfb-6a1c112913b8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2396500
Jun 01 18:47:43.595886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:43.650774 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:43.686484 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f772f44-3c61-452d-a6e2-711751e4c985 req-fc458a30-b971-4558-bf4b-3f42734e927d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:43.688289 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f772f44-3c61-452d-a6e2-711751e4c985 req-fc458a30-b971-4558-bf4b-3f42734e927d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.6478813
Jun 01 18:47:43.700049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.736213 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:47:43.760038 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:43.836995 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-a0af5095-f8c8-4fd4-9746-ee69aa2d507d service neutron] 10.222.0.22 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2500389
Jun 01 18:47:43.909673 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f772f44-3c61-452d-a6e2-711751e4c985 req-07717d9d-98ef-456f-9ef2-901c1b10b081 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2124348
Jun 01 18:47:44.093635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.136094 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 969881a4-e1be-405f-8d2a-24f457975526 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:44.154639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:44.163956 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-57845be7-3cb7-42be-a0d1-7cfec4c8ea8c service neutron] 10.222.0.22 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3259375
Jun 01 18:47:44.228347 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e5aa0d83-8a4e-4fc3-bd90-10bd277dd6fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.232161 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:44.257993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:44.272995 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:44.293482 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 969881a4-e1be-405f-8d2a-24f457975526 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:44.299124 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 969881a4-e1be-405f-8d2a-24f457975526 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:44.299688 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.370159 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.378203 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Pushing event updated for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:44.398190 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd72c850>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '969881a4-e1be-405f-8d2a-24f457975526', 'name': '', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'mac_address': 'fa:16:3e:e5:51:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_interface', 'standard_attr_id': 113, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:31Z', 'updated_at': '2021-06-01T18:47:43Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'subnets': [{'id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:47:44.418328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:44.424625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d1da3f7-aa96-4a09-a0ee-dd7e784e1594 None None] The sync data for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi is: [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:33Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '969881a4-e1be-405f-8d2a-24f457975526', 'name': '', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'mac_address': 'fa:16:3e:e5:51:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_interface', 'standard_attr_id': 113, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:31Z', 'updated_at': '2021-06-01T18:47:43Z', 'revision_number': 4, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'subnets': [{'id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:47:44.459198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:44.459946 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.562732 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3916c102-84af-46b2-b25c-8695d4a7fbb1 req-f4eb053b-e59e-43ee-b103-432653ee801d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 210 time: 0.1220622
Jun 01 18:47:44.585312 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.607186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:47:44.611919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c640dd6-2116-431f-abf8-04e1e96b6768" -d '{"events": [{"name": "network-changed", "server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:47:44.676248 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 969881a4-e1be-405f-8d2a-24f457975526, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=969881a4-e1be-405f-8d2a-24f457975526,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:44.689908 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:44.690799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:44.728523 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Allocated IP 172.27.0.90 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/32183154-9af5-4f26-b54c-60841a14967f) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:44.785360 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-176fd0c4-8cfa-4ea7-bfef-5a7fe0fd7f24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:44.797525 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-44084a4e-2d15-4532-b583-49d273f6dbf6 req-0765b9b5-5e63-4c01-882c-46236f065697 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 210 time: 0.1166632
Jun 01 18:47:44.934323 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.008117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af29e79-2f58-4d7e-9b4a-6cf61688cff3 req-52e19063-bd79-43de-977f-443e2972475a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:45.008518 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:45.010000 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2af29e79-2f58-4d7e-9b4a-6cf61688cff3 req-52e19063-bd79-43de-977f-443e2972475a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.8871467
Jun 01 18:47:45.015881 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.4357381
Jun 01 18:47:45.021481 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:45.039000 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:45.046854 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:45.047496 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.077748 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.091927 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Request body: {'port': {'device_id': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:45.176480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:45.233002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302ee2f4-f05b-4489-b7bb-78f778e16a2a req-aaa9be8b-6b0c-44b5-aefe-21f56411a39d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:45.245500 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-302ee2f4-f05b-4489-b7bb-78f778e16a2a req-aaa9be8b-6b0c-44b5-aefe-21f56411a39d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.1538830
Jun 01 18:47:45.329464 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:45.332773 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.369248 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-302ee2f4-f05b-4489-b7bb-78f778e16a2a req-9ea66f9f-2b9a-4d15-965e-ae5717fa11d3 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1240072
Jun 01 18:47:45.390525 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-fa1dd7f4-95c2-483a-b560-478ebb9951d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:45.392821 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-fa1dd7f4-95c2-483a-b560-478ebb9951d8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=aa5c0080-0016-4f5c-9594-aea703cda2d9 HTTP/1.1" status: 200  len: 852 time: 0.7739019
Jun 01 18:47:45.412748 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.426517 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.25', 53773) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:45.444543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:45.450969 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:45.474996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:45.484548 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:45.486629 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:45.595538 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:45.605486 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:45.683551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-36bba9ff-4c50-4b19-9025-2d888b9e3898 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:45.685575 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-36bba9ff-4c50-4b19-9025-2d888b9e3898 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 819 time: 0.2453172
Jun 01 18:47:45.701973 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Request body: {'port': {'device_id': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'admin_state_up': True, 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:45.753464 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=32183154-9af5-4f26-b54c-60841a14967f,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:45.764138 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:47:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aa84c7e-a2a0-4d4c-8fbe-8eabbf8c1db2 x-openstack-request-id: req-1aa84c7e-a2a0-4d4c-8fbe-8eabbf8c1db2 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:47:45.764823 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:47:45.765288 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-1aa84c7e-a2a0-4d4c-8fbe-8eabbf8c1db2 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:47:45.765897 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256', 'status': 'completed', 'code': 200}
Jun 01 18:47:45.787808 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.611s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:45.912829 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c0d3e7b6-38da-44f8-9405-b1cbfee90d53 req-77af096a-dfcb-46f9-bfe0-3fbefa44ed18 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 210 time: 0.0706334
Jun 01 18:47:45.971168 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 969881a4-e1be-405f-8d2a-24f457975526 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:46.234272 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 969881a4-e1be-405f-8d2a-24f457975526 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:46.234653 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.270925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.25', 53777) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:46.342392 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-66e75e6d-d1e2-4865-9bc0-134c531e76ee req-a1acf16f-aef5-495a-9432-fea57425fb82 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 210 time: 0.1385484
Jun 01 18:47:46.360311 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:46.363925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b54280f9-3b4c-49b4-b5a4-610e3328b1af {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:46.370475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Usage tracker for resource:port and tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:46.378148 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.381687 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:46.404403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:46.422946 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Transition to ACTIVE for port object b54280f9-3b4c-49b4-b5a4-610e3328b1af will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:46.514867 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2af29e79-2f58-4d7e-9b4a-6cf61688cff3 req-1f1a14d5-9b3a-4848-a64c-2514f0829fd4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.4306154
Jun 01 18:47:46.542425 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-64077f77-ea75-4536-b6b3-44c67b23c513 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d7df87fc-8cf1-444a-903c-77524e3d6866&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.7754741
Jun 01 18:47:46.556945 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.557099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:47:46.606771 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:46.666575 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:46.666956 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.684814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Made reservation on behalf of 25a97ba1c3dd49d0bba7b78bbfa71df1 for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:46.688272 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.775874 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cd93d024-57bd-4e6e-be0b-91bd79e11134 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.802911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-658f70c1-3132-43b9-b7ec-f1a400d61291 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:46.803370 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-85953f10-69dc-450e-a2ad-078a63790631 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:46.804581 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-85953f10-69dc-450e-a2ad-078a63790631 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 810 time: 0.5311882
Jun 01 18:47:46.804687 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-658f70c1-3132-43b9-b7ec-f1a400d61291 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 1096 time: 1.7936075
Jun 01 18:47:46.876014 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.876387 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:46.939492 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-628dbdb1-7d01-441f-a065-1c5d496ea078 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 379 time: 0.1134233
Jun 01 18:47:46.950027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf76215d-4ba8-423f-819c-b31a11e39348 req-20c69670-d481-417a-8b5c-a1522fb269e5 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:46.951467 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bf76215d-4ba8-423f-819c-b31a11e39348 req-20c69670-d481-417a-8b5c-a1522fb269e5 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.3749290
Jun 01 18:47:46.958413 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'port': {'device_id': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'admin_state_up': True, 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'security_groups': ['b96674db-5c6a-422e-ae72-a439a68bf41a']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:46.977560 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-e502103a-f062-462e-b465-6a77343a6e21 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7a59828a-57a1-4f2b-9392-36cb6d568256 HTTP/1.1" status: 200  len: 217 time: 0.1496046
Jun 01 18:47:47.025238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Pushing event updated for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:47.070532 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:47.071035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60724) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:47.118768 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Allocated IP 172.20.0.8 (7c0d1d41-a033-4bad-b3c8-a15d3b31242e/e5e3f92a-adf7-40b8-b630-052c45a2db57/176d8ea4-da6f-4ccc-b7e0-f05371988c98) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:47.130876 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bf76215d-4ba8-423f-819c-b31a11e39348 req-89480ca2-4553-45d2-bb90-ae1a3aa002cc tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1558697
Jun 01 18:47:47.180874 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:47.182763 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e7788391-f3b5-4ee5-b454-a92c8bc4c63b req-fa936af9-6f6c-4169-9c6a-eef0d08d68a9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:47.202966 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:47.207160 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-5bd41bcb-4231-4207-ac5b-9a9fa5a53bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:47.209189 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-5bd41bcb-4231-4207-ac5b-9a9fa5a53bbf service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.2204878
Jun 01 18:47:47.212799 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-a81bfc0b-979f-4041-8f4b-2d9759b36c8a service neutron] 10.222.0.25 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6539643
Jun 01 18:47:47.214922 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Attempting to bind port b54280f9-3b4c-49b4-b5a4-610e3328b1af on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:47.215259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Attempting to bind port b54280f9-3b4c-49b4-b5a4-610e3328b1af by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:47.215588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Attempting to bind port b54280f9-3b4c-49b4-b5a4-610e3328b1af on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:47.217539 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.242847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Made reservation on behalf of e471347ca004404f94563ac66c74dc87 for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:47.246403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.329184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Port b54280f9-3b4c-49b4-b5a4-610e3328b1af on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:47:47.329184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Attempting to bind port b54280f9-3b4c-49b4-b5a4-610e3328b1af on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:47.358492 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-5332e629-1c8c-4dc9-84b3-4aa1223cbfa8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1015413
Jun 01 18:47:47.358492 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e7788391-f3b5-4ee5-b454-a92c8bc4c63b req-fa936af9-6f6c-4169-9c6a-eef0d08d68a9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:47.358492 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e7788391-f3b5-4ee5-b454-a92c8bc4c63b req-fa936af9-6f6c-4169-9c6a-eef0d08d68a9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 210 time: 0.3059227
Jun 01 18:47:47.360269 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:47.360638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Checking segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:47.361020 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Bound using segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:47.361821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Bound port: b54280f9-3b4c-49b4-b5a4-610e3328b1af, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:47.361821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.374150 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.450293 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:47.494912 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.536070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Allocated IP 172.20.0.11 (87c3456d-8d78-42d4-81e0-1f541c3dcc2f/108da5f2-bebc-4996-9e93-e596166088ad/1f190c93-827a-4047-8b5a-f63e6b4ba061) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:47:47.566079 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Usage tracker for resource:security_group_rule and tenant:85768e4e1e184b4b94a86ab158401520 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:47.723383 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a40921bf-23e0-428b-be9f-6e0a85752ecf req-8fba5b58-d749-4ffa-bd20-8e003cd61d6d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 210 time: 0.1430738
Jun 01 18:47:47.733073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.752660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:47.780176 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:47.830971 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:47.850200 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:47.984612 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Pushing event updated for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:48.002546 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:48.006996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:48.009879 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:48.014473 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:48.069243 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ef42c41-0ced-4f68-aada-f9ebb9d64fe6 req-33ac7aae-a29f-49ea-9a9c-5206820a296e service neutron] 10.222.0.25 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8141367
Jun 01 18:47:48.088561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.088859 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.090441 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:48.126195 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.4294279
Jun 01 18:47:48.135129 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.135721 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-1ea4b53a-a94f-4c6c-bb76-b79026080fe2 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7523553
Jun 01 18:47:48.137360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:48.146845 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Request body: {'port': {'device_id': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:48.197595 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Transition to ACTIVE for port object 1f190c93-827a-4047-8b5a-f63e6b4ba061 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:48.204822 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.247285 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:48.281316 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.321447 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.323904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.350186 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.351889 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d362dc4-c330-4893-854d-2c6ad9b2fcde req-7cf9c18b-caf8-4227-a5e4-c6cf367ca5af tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.358670 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0d362dc4-c330-4893-854d-2c6ad9b2fcde req-7cf9c18b-caf8-4227-a5e4-c6cf367ca5af tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.5306587
Jun 01 18:47:48.429847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.430459 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.431833 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] 10.222.0.25 "PUT /v2.0/ports/b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 1093 time: 3.3476865
Jun 01 18:47:48.432461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:47:48.434850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-685dd6f6-5885-4d6c-810a-c2cd28cdf401" -d '{"events": [{"name": "network-changed", "server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:47:48.471793 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:48.548990 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:47:48.564997 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:47:48.573849 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:47:48.590909 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.596347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Pushing event updated for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:48.623942 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.377s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:48.624849 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.628461 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0d362dc4-c330-4893-854d-2c6ad9b2fcde req-9df58dc2-d77e-498a-bb60-aa6cd40ccc7e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2689600
Jun 01 18:47:48.628937 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.197s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:48.666489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d6bc7a-1913-4794-be08-b2895a9f21e3 req-699ec953-290f-4788-b2b1-7b13b1edfa4f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.668003 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-13d6bc7a-1913-4794-be08-b2895a9f21e3 req-699ec953-290f-4788-b2b1-7b13b1edfa4f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.4046838
Jun 01 18:47:48.681253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:48.689442 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:48.690718 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab22b58e-3a52-46b2-87e7-2d5e099eb314 req-4067060d-8b00-454b-b323-f95edc81c9de service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5127096
Jun 01 18:47:48.707262 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.736962 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8966588-283f-4af8-bad8-723876420f68 req-e485c086-8528-426b-8f09-5e81d49443f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.738481 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-e485c086-8528-426b-8f09-5e81d49443f4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=59a3ecd15231441e9ed00898e50aae60&device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 1096 time: 0.5953577
Jun 01 18:47:48.756412 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=85768e4e1e184b4b94a86ab158401520&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6684954
Jun 01 18:47:48.757141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=32183154-9af5-4f26-b54c-60841a14967f,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:48.759947 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:48.761124 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60762) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:48.761785 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.064s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:48.772346 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:48.773034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.827311 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-13d6bc7a-1913-4794-be08-b2895a9f21e3 req-fd5b6953-580d-418c-ab71-8cb0be1bd556 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1389997
Jun 01 18:47:48.830493 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-487a796a-3db5-4edd-9ceb-d0752ef0f2dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.8758292
Jun 01 18:47:48.865971 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.875278 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 5.3452826
Jun 01 18:47:48.911512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:47:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42eeea22-4f95-4908-bbdd-1674049b8603 x-openstack-request-id: req-42eeea22-4f95-4908-bbdd-1674049b8603 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:47:48.911796 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-07a6e403-00f2-43c1-861a-4d6c3621e426 None None] Provisioning for port 1f190c93-827a-4047-8b5a-f63e6b4ba061 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:47:48.912949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:47:48.913506 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-42eeea22-4f95-4908-bbdd-1674049b8603 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:47:48.915012 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af', 'status': 'completed', 'code': 200}
Jun 01 18:47:48.917038 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-07a6e403-00f2-43c1-861a-4d6c3621e426 None None] Provisioning complete for port 1f190c93-827a-4047-8b5a-f63e6b4ba061 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:47:48.917422 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-07a6e403-00f2-43c1-861a-4d6c3621e426 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.920104 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa49f575-9f29-4a36-98ec-5c566e8cf491,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:48.924655 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:48.957117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:48.995778 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.027576 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-07a6e403-00f2-43c1-861a-4d6c3621e426 None None] Port 1f190c93-827a-4047-8b5a-f63e6b4ba061 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:47:49.041027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 176d8ea4-da6f-4ccc-b7e0-f05371988c98 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:49.046176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a959006b-c931-40a2-8522-a106b89cb9b1 req-505b52c1-ca3f-49c1-97d6-0b9f563ce9ac tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:49.049440 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.052927 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a959006b-c931-40a2-8522-a106b89cb9b1 req-505b52c1-ca3f-49c1-97d6-0b9f563ce9ac tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 931 time: 0.2668500
Jun 01 18:47:49.105209 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Transition to ACTIVE for port object 176d8ea4-da6f-4ccc-b7e0-f05371988c98 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:49.108273 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a959006b-c931-40a2-8522-a106b89cb9b1 req-b91e905d-5c16-47a6-9309-8a7b6d1fbf41 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524104
Jun 01 18:47:49.111603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.132863 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8ce005a-fa3d-46c0-827f-e8f24cafb55c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:49.134351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.140238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:49.155824 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa49f575-9f29-4a36-98ec-5c566e8cf491,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:49.158790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:49.159740 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.160897 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/aa49f575-9f29-4a36-98ec-5c566e8cf491 HTTP/1.1" status: 204  len: 168 time: 0.3891470
Jun 01 18:47:49.272533 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-4a7f0667-2278-4164-bc88-d66175603cd4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-securitygroup--1467507370&fields=id&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 267 time: 0.0417712
Jun 01 18:47:49.308865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2390a8b8-a093-4f60-8f0f-3c0fde919858 req-64b650eb-22bb-40de-8d2e-207aac774f02 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:49.309769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-2390a8b8-a093-4f60-8f0f-3c0fde919858 req-64b650eb-22bb-40de-8d2e-207aac774f02 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:49.390555 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Pushing event updated for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:49.400507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:49.420658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-2390a8b8-a093-4f60-8f0f-3c0fde919858 req-64b650eb-22bb-40de-8d2e-207aac774f02 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:49.424940 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2390a8b8-a093-4f60-8f0f-3c0fde919858 req-64b650eb-22bb-40de-8d2e-207aac774f02 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 932 time: 0.3721385
Jun 01 18:47:49.434130 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-85ba04c4-26d2-402f-bc55-a2ce0e627fdf tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:49.435626 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-85ba04c4-26d2-402f-bc55-a2ce0e627fdf tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 817 time: 0.1559134
Jun 01 18:47:49.459383 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-ed4d774c-8124-4020-865e-36357653f442 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/quotas/41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 375 time: 0.0172141
Jun 01 18:47:49.473318 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Attempting to bind port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:49.473775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Attempting to bind port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:49.474136 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Attempting to bind port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:49.483482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:47:49.483806 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Attempting to bind port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 on network 7c0d1d41-a033-4bad-b3c8-a15d3b31242e {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:49.492003 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2390a8b8-a093-4f60-8f0f-3c0fde919858 req-8e240f20-9856-42e6-855e-0b996c568d39 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0634756
Jun 01 18:47:49.498316 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:49.498671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Checking segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:49.499319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Bound using segment: {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:49.500332 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Bound port: 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '69b1d8dc-90f3-4b2d-912f-ef992caee9a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 59, 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:49.500483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.500846 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 60784) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:49.523228 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.530188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.547931 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:49.553911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Usage tracker for resource:security_group_rule and tenant:af1b108b4fc84446abe8cafef4a20b72 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:47:49.563317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:47:49.570934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:49.592589 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:49.596826 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:49.601836 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.606909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:49.616313 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-7350fedb-adb0-4317-89f6-7d3ddd72ee1f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:49.659230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-7350fedb-adb0-4317-89f6-7d3ddd72ee1f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:49.674583 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-7350fedb-adb0-4317-89f6-7d3ddd72ee1f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2127986
Jun 01 18:47:49.675063 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:49.675801 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.677150 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] 10.222.0.25 "PUT /v2.0/ports/176d8ea4-da6f-4ccc-b7e0-f05371988c98 HTTP/1.1" status: 200  len: 1093 time: 1.5383708
Jun 01 18:47:49.678515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:47:49.711139 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Pushing event updated for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:49.715323 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:49.818399 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.826417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:49.843077 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d062aa20-0a11-44e8-8a66-80fdade2edf9" -d '{"events": [{"name": "network-changed", "server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:47:49.846186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:49.853714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b6f944-bdf0-476a-b45c-1f5bd0784e88 req-a568c17d-7342-40d2-b114-a0abd79b7ac0 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:49.855330 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-01b6f944-bdf0-476a-b45c-1f5bd0784e88 req-a568c17d-7342-40d2-b114-a0abd79b7ac0 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.1008246
Jun 01 18:47:49.899746 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=af1b108b4fc84446abe8cafef4a20b72&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3973184
Jun 01 18:47:49.902946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 60796) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:49.904362 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-3885dce1-f01a-45e6-a7f8-c71f79ea3907 service neutron] 10.222.0.22 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2181487
Jun 01 18:47:49.905800 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23c67e66-1153-46f3-ba0d-06567580b158,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:49.907682 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-01b6f944-bdf0-476a-b45c-1f5bd0784e88 req-46d41e5c-eee9-433b-a342-49ba26f042c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461111
Jun 01 18:47:49.908842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:49.974941 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:50.009988 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:50.030236 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:47:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5d1cfab-a3d3-4331-aff6-65e315e9e331 x-openstack-request-id: req-a5d1cfab-a3d3-4331-aff6-65e315e9e331 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:47:50.030550 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:47:50.030811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-a5d1cfab-a3d3-4331-aff6-65e315e9e331 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:47:50.031349 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98', 'status': 'completed', 'code': 200}
Jun 01 18:47:50.047268 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f74384a0-e49a-49c5-a3b2-6a896599942f service neutron] 10.222.0.22 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1366792
Jun 01 18:47:50.074430 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:50.082328 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:50.094731 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23c67e66-1153-46f3-ba0d-06567580b158,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:50.097699 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:50.099747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:50.100885 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/23c67e66-1153-46f3-ba0d-06567580b158 HTTP/1.1" status: 204  len: 168 time: 0.1969094
Jun 01 18:47:50.224271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751489b1-dc37-40ab-8adf-f2036eb76c1a req-2eaa463a-0570-474b-814b-3072619aeb95 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:50.226164 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-751489b1-dc37-40ab-8adf-f2036eb76c1a req-2eaa463a-0570-474b-814b-3072619aeb95 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.1031735
Jun 01 18:47:50.300982 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-751489b1-dc37-40ab-8adf-f2036eb76c1a req-41b3613a-db1e-4c61-8e4e-d39e95196a38 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689290
Jun 01 18:47:50.405046 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f3480aa2-675f-438c-ac3d-f9974c665504 req-940cb7f4-257e-4363-84ad-f73e4b153df1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0627115
Jun 01 18:47:50.498335 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38d1c22-e023-44bd-ad37-c09948524fb2 req-d6331a75-8870-4dcf-9790-ab03c78b7f93 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:50.507097 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a38d1c22-e023-44bd-ad37-c09948524fb2 req-d6331a75-8870-4dcf-9790-ab03c78b7f93 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.2034822
Jun 01 18:47:50.557262 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a38d1c22-e023-44bd-ad37-c09948524fb2 req-2ddf3460-96aa-4662-a6e4-3fd6ffb4b090 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489414
Jun 01 18:47:50.724459 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971ec767-ec88-40ee-9a00-e6bdf453b9d4 req-7371587a-1c4b-4d2c-bdfa-a6c0bf645b88 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:50.725975 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-971ec767-ec88-40ee-9a00-e6bdf453b9d4 req-7371587a-1c4b-4d2c-bdfa-a6c0bf645b88 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 932 time: 0.0843594
Jun 01 18:47:50.781322 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-971ec767-ec88-40ee-9a00-e6bdf453b9d4 req-2da5a6b0-929b-4410-aeb8-e3e26755d62d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497689
Jun 01 18:47:51.096701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8d31377-7fd7-4018-9a2c-311b38fada2b req-9827a027-d37f-4fc5-9345-b5bb6889c044 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:51.098184 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8d31377-7fd7-4018-9a2c-311b38fada2b req-9827a027-d37f-4fc5-9345-b5bb6889c044 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.0813255
Jun 01 18:47:51.144208 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8d31377-7fd7-4018-9a2c-311b38fada2b req-b6fe91e9-1e11-48a2-9cc9-d344846d4758 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398469
Jun 01 18:47:51.481593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c7b7f5-46da-4641-9962-aad1490bfbb9 req-bfbb52b6-7890-4d7a-9b80-3112cbd95062 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:51.483148 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a2c7b7f5-46da-4641-9962-aad1490bfbb9 req-bfbb52b6-7890-4d7a-9b80-3112cbd95062 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.0855806
Jun 01 18:47:51.536548 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a2c7b7f5-46da-4641-9962-aad1490bfbb9 req-c9a4a0be-0cf5-4ce4-a32e-5bb3c6d66718 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456526
Jun 01 18:47:51.543053 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Request body: {'port': {'device_id': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:51.659139 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ba761443-4fcb-4951-8b81-3f8090f74b2d req-8150feff-421c-4d87-9316-eeba16c0a1d5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.1511796
Jun 01 18:47:51.845000 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:51.872572 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8966588-283f-4af8-bad8-723876420f68 req-e50f8e2a-ae21-4f5d-a44d-cb519cde4116 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:51.874206 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-e50f8e2a-ae21-4f5d-a44d-cb519cde4116 service neutron] 10.222.0.25 "GET /v2.0/networks?id=d7df87fc-8cf1-444a-903c-77524e3d6866 HTTP/1.1" status: 200  len: 912 time: 0.2981431
Jun 01 18:47:51.881198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-86caae81-7dd2-4d73-80dd-c25ba9dd1a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:51.883020 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-86caae81-7dd2-4d73-80dd-c25ba9dd1a71 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1096 time: 0.3059049
Jun 01 18:47:52.012634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-b0695ab5-67c7-4e0c-9f5c-cbeb4e6a1fea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.018169 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-b0695ab5-67c7-4e0c-9f5c-cbeb4e6a1fea service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1096 time: 0.4444370
Jun 01 18:47:52.042745 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-73ea5865-a0e7-4593-bc0f-e0ea60d52303 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d39deb11-706c-4a8b-a636-d8d69ede4926 HTTP/1.1" status: 200  len: 217 time: 0.1579854
Jun 01 18:47:52.044629 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-cfc5f96c-9344-4ba0-9cad-527cb0605e85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.046007 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-cfc5f96c-9344-4ba0-9cad-527cb0605e85 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 1096 time: 0.3896761
Jun 01 18:47:52.116795 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3d6281db-fc92-4c8a-8ba8-cd68817f7cd8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.117895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3d6281db-fc92-4c8a-8ba8-cd68817f7cd8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:52.154982 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3d6281db-fc92-4c8a-8ba8-cd68817f7cd8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:52.156167 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3d6281db-fc92-4c8a-8ba8-cd68817f7cd8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.3548028
Jun 01 18:47:52.179103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf2d108-b243-4cc2-ba94-cd1753644529 req-4a290b3c-76b7-4d06-be91-50475589a13a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.180632 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-faf2d108-b243-4cc2-ba94-cd1753644529 req-4a290b3c-76b7-4d06-be91-50475589a13a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 932 time: 0.2299268
Jun 01 18:47:52.181643 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-1cd27b1e-e7bb-43a4-803e-b734627e1750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.182962 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-1cd27b1e-e7bb-43a4-803e-b734627e1750 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&shared=False HTTP/1.1" status: 200  len: 919 time: 0.2003832
Jun 01 18:47:52.228308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-faf2d108-b243-4cc2-ba94-cd1753644529 req-794bd1a8-76c0-40f5-841b-7e17ea878aed tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:52.246724 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-faf2d108-b243-4cc2-ba94-cd1753644529 req-794bd1a8-76c0-40f5-841b-7e17ea878aed tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:52.253184 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-faf2d108-b243-4cc2-ba94-cd1753644529 req-794bd1a8-76c0-40f5-841b-7e17ea878aed tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0661886
Jun 01 18:47:52.273765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3e83c837-d9cd-42c1-8441-5c9701b1f2fb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:52.315831 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3e83c837-d9cd-42c1-8441-5c9701b1f2fb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:52.329461 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e09b0af-268e-4a4d-b098-5b30dc728008 req-3e83c837-d9cd-42c1-8441-5c9701b1f2fb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1594927
Jun 01 18:47:52.422355 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f190c93-827a-4047-8b5a-f63e6b4ba061 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:52.430979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:52.447701 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Transition to ACTIVE for port object 1f190c93-827a-4047-8b5a-f63e6b4ba061 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:47:52.451581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:52.463595 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ff5566-4f72-4e6c-b66b-f530d820db33 req-8dfe7d51-f77d-4f08-b31c-ec674c38715f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.465141 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-28ff5566-4f72-4e6c-b66b-f530d820db33 req-8dfe7d51-f77d-4f08-b31c-ec674c38715f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.0870340
Jun 01 18:47:52.474768 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-625a9139-3e65-4ea6-9afc-a09f857eb3bb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:52.518562 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-28ff5566-4f72-4e6c-b66b-f530d820db33 req-cd3a39c1-5bae-4917-b51b-1b399473d354 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453012
Jun 01 18:47:52.660814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Pushing event updated for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:52.664507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:52.810132 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Attempting to bind port 1f190c93-827a-4047-8b5a-f63e6b4ba061 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:47:52.810498 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Attempting to bind port 1f190c93-827a-4047-8b5a-f63e6b4ba061 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:47:52.810889 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Attempting to bind port 1f190c93-827a-4047-8b5a-f63e6b4ba061 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:52.818701 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Port 1f190c93-827a-4047-8b5a-f63e6b4ba061 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:47:52.819010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Attempting to bind port 1f190c93-827a-4047-8b5a-f63e6b4ba061 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:47:52.831012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65747fae-c49d-46f1-b92e-b00566244ef7 req-fc1dc46c-17db-4f86-8bac-b61450e993ef tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:52.831356 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f65c6fa2-09ea-4a03-ba73-d0468b9f1895 req-c46e8e9f-9b45-4f15-88b1-6dec4e30c01e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0448415
Jun 01 18:47:52.832461 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65747fae-c49d-46f1-b92e-b00566244ef7 req-fc1dc46c-17db-4f86-8bac-b61450e993ef tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.1298072
Jun 01 18:47:52.833974 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:47:52.834299 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Checking segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:47:52.834666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Bound using segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:47:52.835097 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Bound port: 1f190c93-827a-4047-8b5a-f63e6b4ba061, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:47:52.835485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:52.931343 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65747fae-c49d-46f1-b92e-b00566244ef7 req-4be8e14f-8855-4334-a94f-71f2281c36e7 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0868905
Jun 01 18:47:52.956548 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:47:52.959981 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:47:52.964341 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:52.967977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e53b1e00-4766-47bf-bcd4-675b46ea5339 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:53.023543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:53.024160 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:53.025526 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] 10.222.0.25 "PUT /v2.0/ports/1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 1094 time: 1.4869444
Jun 01 18:47:53.026267 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:47:53.028497 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-172bd294-0dd4-41a5-852f-50322826d2aa" -d '{"events": [{"name": "network-changed", "server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:47:53.045843 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Pushing event updated for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:53.048965 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:53.108066 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:47:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9067d4b1-0fc6-4479-9f89-36d85d6d5754 x-openstack-request-id: req-9067d4b1-0fc6-4479-9f89-36d85d6d5754 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:47:53.108501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:47:53.108777 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-9067d4b1-0fc6-4479-9f89-36d85d6d5754 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:47:53.109192 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'status': 'completed', 'code': 200}
Jun 01 18:47:53.435630 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9513885-185f-4eab-994c-531f1cf0d033 req-605adf6e-eb85-46c5-bb6b-6a31f15c7e77 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:53.437133 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9513885-185f-4eab-994c-531f1cf0d033 req-605adf6e-eb85-46c5-bb6b-6a31f15c7e77 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0837088
Jun 01 18:47:53.482092 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9513885-185f-4eab-994c-531f1cf0d033 req-006f489d-dedd-440f-b730-baff424aaabd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394061
Jun 01 18:47:53.514350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f30178-c16b-477d-9b69-8fe4a2efd3d2 req-d07ddd51-bde4-4f25-bb2d-776f928b50b5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:53.515798 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c5f30178-c16b-477d-9b69-8fe4a2efd3d2 req-d07ddd51-bde4-4f25-bb2d-776f928b50b5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0802279
Jun 01 18:47:53.560012 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c5f30178-c16b-477d-9b69-8fe4a2efd3d2 req-b742f7d1-4cac-4cb5-8dd9-179248bdb844 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377066
Jun 01 18:47:53.716794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7036f4-fc9c-4ec4-bf18-ed5a8d7ec82f req-b49b98cb-9f4f-4f0f-8787-8519cb08504b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:53.718258 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e7036f4-fc9c-4ec4-bf18-ed5a8d7ec82f req-b49b98cb-9f4f-4f0f-8787-8519cb08504b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.0821939
Jun 01 18:47:53.765055 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e7036f4-fc9c-4ec4-bf18-ed5a8d7ec82f req-734a5577-f363-4023-8177-25f11361fea1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410838
Jun 01 18:47:53.984967 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-fc5c4fb3-d2e8-4e4c-91d6-0dcc5cd748c4 req-cade7cda-997d-402d-91fd-f76224a6ecf3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0451033
Jun 01 18:47:54.113861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba6c51c-3ab4-4510-9c27-7d721fe972b7 req-46306454-3507-4c19-9f06-1eda48bac880 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:54.115734 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ba6c51c-3ab4-4510-9c27-7d721fe972b7 req-46306454-3507-4c19-9f06-1eda48bac880 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.0784626
Jun 01 18:47:54.158603 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ba6c51c-3ab4-4510-9c27-7d721fe972b7 req-564ee499-26ff-44e5-8441-aea25de9b923 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374105
Jun 01 18:47:54.665755 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d0f86f-735f-4ca6-a238-7938dcecf2f4 req-dbb33d85-be5b-40a3-8f04-68fbc489deb0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:54.667236 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e3d0f86f-735f-4ca6-a238-7938dcecf2f4 req-dbb33d85-be5b-40a3-8f04-68fbc489deb0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0818245
Jun 01 18:47:54.711504 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e3d0f86f-735f-4ca6-a238-7938dcecf2f4 req-63275efa-aa53-47cc-a76f-7d1e4dd4bdcd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386612
Jun 01 18:47:54.749800 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39938d04-841e-487b-a3d4-7ca5823c87f1 req-856d738c-c3db-48f1-b68b-3fdb1537d8af tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:54.751255 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-39938d04-841e-487b-a3d4-7ca5823c87f1 req-856d738c-c3db-48f1-b68b-3fdb1537d8af tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0837481
Jun 01 18:47:54.797938 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-39938d04-841e-487b-a3d4-7ca5823c87f1 req-a9b40ca3-4003-4db4-96f8-4e3e666316e7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408785
Jun 01 18:47:55.171721 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9bba014e-ee51-4ee8-a534-ad5fed2399d6 req-5e0982a1-f6d9-4d02-94c5-f668f4e136e6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0659666
Jun 01 18:47:55.195964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-b7abf150-a620-46c5-a605-befd70b24c73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.197476 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-b7abf150-a620-46c5-a605-befd70b24c73 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&shared=False HTTP/1.1" status: 200  len: 919 time: 0.3046122
Jun 01 18:47:55.230388 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172bd294-0dd4-41a5-852f-50322826d2aa req-e4bb6183-c57b-4de4-acd9-a2ca63bdbe12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.231872 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-172bd294-0dd4-41a5-852f-50322826d2aa req-e4bb6183-c57b-4de4-acd9-a2ca63bdbe12 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1097 time: 0.3149965
Jun 01 18:47:55.241120 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8966588-283f-4af8-bad8-723876420f68 req-8ae4939d-cb22-4116-846a-621c98f3105d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.242576 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-8ae4939d-cb22-4116-846a-621c98f3105d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=aa5c0080-0016-4f5c-9594-aea703cda2d9 HTTP/1.1" status: 200  len: 852 time: 0.3344808
Jun 01 18:47:55.343463 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-b4ced7e3-037d-49aa-bea4-c5937e194c67 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d7df87fc-8cf1-444a-903c-77524e3d6866&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0777357
Jun 01 18:47:55.349476 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-43a5ce33-9d41-4df7-ade0-98e317dca48a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.350812 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-43a5ce33-9d41-4df7-ade0-98e317dca48a service neutron] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 915 time: 0.4407618
Jun 01 18:47:55.355390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-b9c5c03a-50dc-48ae-8952-05f3f65ad315 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.356735 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d062aa20-0a11-44e8-8a66-80fdade2edf9 req-b9c5c03a-50dc-48ae-8952-05f3f65ad315 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 869 time: 0.4475780
Jun 01 18:47:55.364817 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc661ab-0899-4f0f-ad38-cc5907b70add req-cb33607f-72a5-49ba-b959-ed9ada410777 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.366205 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3dc661ab-0899-4f0f-ad38-cc5907b70add req-cb33607f-72a5-49ba-b959-ed9ada410777 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.4936278
Jun 01 18:47:55.415143 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3dc661ab-0899-4f0f-ad38-cc5907b70add req-8f336e6b-42ab-4852-97f7-3cd8982ca4bd tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425999
Jun 01 18:47:55.509222 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-eb863a92-65a2-49a4-8ef1-c77c056ad5ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.510680 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-685dd6f6-5885-4d6c-810a-c2cd28cdf401 req-eb863a92-65a2-49a4-8ef1-c77c056ad5ec service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 869 time: 0.3037956
Jun 01 18:47:55.535364 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172bd294-0dd4-41a5-852f-50322826d2aa req-3ea34785-0b55-4140-9c5e-205e84ae3321 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.536650 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-172bd294-0dd4-41a5-852f-50322826d2aa req-3ea34785-0b55-4140-9c5e-205e84ae3321 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=e471347ca004404f94563ac66c74dc87&shared=False HTTP/1.1" status: 200  len: 910 time: 0.2860658
Jun 01 18:47:55.548750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d797aed3-3458-4044-b9c8-a25f19041a5e req-f5886f66-0bf1-408f-93a8-feaa8bf87b50 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.550147 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d797aed3-3458-4044-b9c8-a25f19041a5e req-f5886f66-0bf1-408f-93a8-feaa8bf87b50 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.2197177
Jun 01 18:47:55.594615 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d797aed3-3458-4044-b9c8-a25f19041a5e req-67fa9f6a-3687-435f-87d2-3b02d04d701e tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381689
Jun 01 18:47:55.905648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca461bd-d12a-46d3-91da-1fa01edf3f36 req-54a2f72c-6f2e-47bd-bcf4-34a5be6c3751 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.907252 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-aca461bd-d12a-46d3-91da-1fa01edf3f36 req-54a2f72c-6f2e-47bd-bcf4-34a5be6c3751 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0823116
Jun 01 18:47:55.951487 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-aca461bd-d12a-46d3-91da-1fa01edf3f36 req-ff957cde-a2d0-41c7-be62-c2d8b23ee606 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381851
Jun 01 18:47:55.984246 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30294838-783d-44be-8031-d256d7515a38 req-cb8b9c22-a746-481a-bc3a-a4a28f243db1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:55.985718 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-30294838-783d-44be-8031-d256d7515a38 req-cb8b9c22-a746-481a-bc3a-a4a28f243db1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0788887
Jun 01 18:47:56.029191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-30294838-783d-44be-8031-d256d7515a38 req-52756a80-acff-488d-bb8f-0d1e01dc6840 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378697
Jun 01 18:47:56.344608 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-91c8e7a5-2b0e-43b9-87bf-9fcef03c71a9 req-7f8add72-ab05-4fb7-951a-c5254e576045 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0481477
Jun 01 18:47:56.599429 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd0312d-e359-4b9a-bb55-638294e0e49f req-01e0baeb-9282-4e7b-a098-a279370d07d8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:56.600793 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8fd0312d-e359-4b9a-bb55-638294e0e49f req-01e0baeb-9282-4e7b-a098-a279370d07d8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.0836964
Jun 01 18:47:56.644560 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8fd0312d-e359-4b9a-bb55-638294e0e49f req-e9432af2-daec-4e2d-8eaf-bfff2e476290 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382276
Jun 01 18:47:56.780283 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6497ed3e-be53-4db6-9b82-10af7964c9f7 req-937648a6-42ca-4844-b210-7f6bc51d911b tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:56.781767 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6497ed3e-be53-4db6-9b82-10af7964c9f7 req-937648a6-42ca-4844-b210-7f6bc51d911b tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.0792334
Jun 01 18:47:56.825586 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6497ed3e-be53-4db6-9b82-10af7964c9f7 req-dbaa3d3b-83d9-4fcb-8472-f8c893b825e0 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377090
Jun 01 18:47:57.134828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e57bcb42-b3aa-42bc-8021-ff2e638936e8 req-64799848-23b9-4359-ac39-d8f1cc9e3b67 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:57.136280 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e57bcb42-b3aa-42bc-8021-ff2e638936e8 req-64799848-23b9-4359-ac39-d8f1cc9e3b67 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0784962
Jun 01 18:47:57.180829 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e57bcb42-b3aa-42bc-8021-ff2e638936e8 req-20c1d2b6-0715-4130-ac16-b5ee41219a2e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390446
Jun 01 18:47:57.211850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e60141f-84de-40a9-9fe4-69eba446eae6 req-24074ab6-534b-4925-ad38-5993b7e3f989 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:57.213353 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3e60141f-84de-40a9-9fe4-69eba446eae6 req-24074ab6-534b-4925-ad38-5993b7e3f989 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0830398
Jun 01 18:47:57.257149 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3e60141f-84de-40a9-9fe4-69eba446eae6 req-1b2c0a35-c674-42b6-9868-8be95a5546b3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380416
Jun 01 18:47:57.496447 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ee0133b7-cafb-428d-8d1b-61dd196f4798 req-3cff09a8-23bf-473e-a6c3-f84959674828 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0447083
Jun 01 18:47:57.826411 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9c1419-f97c-47bf-8f75-ba3ea6e96a2e req-3a680b42-3cc0-4de4-8b58-60b743c0a69b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:57.828189 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b9c1419-f97c-47bf-8f75-ba3ea6e96a2e req-3a680b42-3cc0-4de4-8b58-60b743c0a69b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 943 time: 0.0792458
Jun 01 18:47:57.872666 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b9c1419-f97c-47bf-8f75-ba3ea6e96a2e req-870472e8-2548-4961-a970-d8620a7943fb tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385969
Jun 01 18:47:58.006567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5fab63f-c684-4265-9b0f-23a7341462da req-2f0e1dad-bf5c-4208-88b4-c5494c65fc82 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.007999 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e5fab63f-c684-4265-9b0f-23a7341462da req-2f0e1dad-bf5c-4208-88b4-c5494c65fc82 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 943 time: 0.0787110
Jun 01 18:47:58.054236 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e5fab63f-c684-4265-9b0f-23a7341462da req-b8a237c4-5d54-4f27-bdaf-70510088aa20 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403111
Jun 01 18:47:58.342780 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.25', 53785) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:47:58.461618 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device d39deb11-706c-4a8b-a636-d8d69ede4926 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:47:58.515814 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-32a55d81-7249-462e-a3b1-45f2897b40f6 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7a59828a-57a1-4f2b-9392-36cb6d568256 HTTP/1.1" status: 200  len: 217 time: 0.2298315
Jun 01 18:47:58.617853 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=d39deb11-706c-4a8b-a636-d8d69ede4926,segment=NetworkSegment(ade580c3-c29b-43be-bce2-a56993c1cb04),segment_id=ade580c3-c29b-43be-bce2-a56993c1cb04)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:58.636072 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': 'd39deb11-706c-4a8b-a636-d8d69ede4926', 'network_id': 'd7df87fc-8cf1-444a-903c-77524e3d6866', 'port_id': 'd39deb11-706c-4a8b-a636-d8d69ede4926', 'mac_address': 'fa:16:3e:d8:48:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 52, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa5c0080-0016-4f5c-9594-aea703cda2d9', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:47:58.690827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-d69bd281-d325-4ec3-9597-df5f7d044ae5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.692338 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-d69bd281-d325-4ec3-9597-df5f7d044ae5 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.1665943
Jun 01 18:47:58.697911 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:58.700742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172bd294-0dd4-41a5-852f-50322826d2aa req-0b2a7006-a2ab-4d51-a95a-93f02e161293 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.702191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-172bd294-0dd4-41a5-852f-50322826d2aa req-0b2a7006-a2ab-4d51-a95a-93f02e161293 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 869 time: 0.4066479
Jun 01 18:47:58.720699 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d39deb11-706c-4a8b-a636-d8d69ede4926 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:58.733659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1032932b-6ddf-458f-a35f-18f4d9300a3d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.734381 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1032932b-6ddf-458f-a35f-18f4d9300a3d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:58.742281 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-89513894-3dfe-4cca-8199-543535c727be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.742495 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-01a402e8-4368-406b-9ef4-600ced68f7e8 service neutron] 10.222.0.25 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4549079
Jun 01 18:47:58.743709 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-89513894-3dfe-4cca-8199-543535c727be service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1096 time: 0.3976138
Jun 01 18:47:58.754919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c587044d-dd3e-4a9d-8c9f-93e51129b8ec req-5796ec98-64e7-48eb-822d-25147cec56a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.755542 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=d39deb11-706c-4a8b-a636-d8d69ede4926,segment=NetworkSegment(ade580c3-c29b-43be-bce2-a56993c1cb04),segment_id=ade580c3-c29b-43be-bce2-a56993c1cb04)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:58.759735 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-ed6639fc-f454-4d0f-a939-8955c2f24f5b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0559464
Jun 01 18:47:58.759896 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:58.760747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 7a59828a-57a1-4f2b-9392-36cb6d568256 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:47:58.762613 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c587044d-dd3e-4a9d-8c9f-93e51129b8ec req-5796ec98-64e7-48eb-822d-25147cec56a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.3774900
Jun 01 18:47:58.763025 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:58.786928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cc2c71-fb85-4dc1-9b80-1696a8c4a147 req-7f170282-08de-4f27-bc61-4c33e2d9bcad tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.793655 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-88cc2c71-fb85-4dc1-9b80-1696a8c4a147 req-7f170282-08de-4f27-bc61-4c33e2d9bcad tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.5046353
Jun 01 18:47:58.874351 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:58.877761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:58.974858 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=7a59828a-57a1-4f2b-9392-36cb6d568256,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:58.982154 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1032932b-6ddf-458f-a35f-18f4d9300a3d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:58.983266 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1032932b-6ddf-458f-a35f-18f4d9300a3d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 817 time: 0.6638458
Jun 01 18:47:58.986883 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-86984ca9-5b04-4f0d-bee4-a85bd2dd85e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:58.988539 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-f9313311-1c5d-4065-990c-3927a6e1482a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.2241127
Jun 01 18:47:58.989396 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-86984ca9-5b04-4f0d-bee4-a85bd2dd85e0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1096 time: 0.6160989
Jun 01 18:47:58.990383 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '7a59828a-57a1-4f2b-9392-36cb6d568256', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'port_id': '7a59828a-57a1-4f2b-9392-36cb6d568256', 'mac_address': 'fa:16:3e:d2:66:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 92, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b40008fb-ef5f-4ddd-be90-93c9dd2d5423', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:47:59.009928 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c587044d-dd3e-4a9d-8c9f-93e51129b8ec req-16fe71e2-a130-4d73-ac3d-5262abbdce5a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2465250
Jun 01 18:47:59.035212 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-88cc2c71-fb85-4dc1-9b80-1696a8c4a147 req-a3bb483a-53dd-4d6e-8a05-0236f31f1c65 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2361410
Jun 01 18:47:59.092460 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:59.132726 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7a59828a-57a1-4f2b-9392-36cb6d568256 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:47:59.172084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=7a59828a-57a1-4f2b-9392-36cb6d568256,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:47:59.181667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:47:59.184996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:47:59.250161 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-a812cd7b-eee8-4058-b06d-fa5c4deb94b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.251599 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-a812cd7b-eee8-4058-b06d-fa5c4deb94b3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.2381101
Jun 01 18:47:59.260518 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-5a04818b-2b88-4b1d-b786-78af72fb9101 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:47:59.267848 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7bbb2087-af49-4990-bb60-558a2cbbf0e8 req-1e0be431-16ee-4774-abd8-b65af16ee570 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0726573
Jun 01 18:47:59.299765 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-76ba8eac-a6d8-40c6-97cd-36444243bc19 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4889131
Jun 01 18:47:59.302554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-bf9f4fe4-e1ad-4fdb-80f7-b8ef1bfba549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.303983 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-bf9f4fe4-e1ad-4fdb-80f7-b8ef1bfba549 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1097 time: 0.5209479
Jun 01 18:47:59.315356 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:47:59.321299 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:47:59.405291 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-f724fc86-b673-4579-95cb-8ade4ce43f8a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 217 time: 0.0829465
Jun 01 18:47:59.414522 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-d7ed8269-5748-4ba4-84e7-2661e6351f24 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1500406
Jun 01 18:47:59.434176 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-22e7d916-4989-489f-b060-0c7528190ab6 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98 HTTP/1.1" status: 200  len: 217 time: 0.4152863
Jun 01 18:47:59.449331 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-5a04818b-2b88-4b1d-b786-78af72fb9101 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:47:59.450597 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-5a04818b-2b88-4b1d-b786-78af72fb9101 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 380 time: 0.3659096
Jun 01 18:47:59.512863 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['d39deb11-706c-4a8b-a636-d8d69ede4926'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:47:59.528396 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'port': {'device_id': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'admin_state_up': True, 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'security_groups': ['d9e249d0-daec-40d3-8b1c-207330b726e0']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:47:59.597358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:47:59.738181 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-dda69c4f-5d6c-4674-b19c-f4b830db6981 service neutron] 10.222.0.25 "GET /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.9822931
Jun 01 18:47:59.778442 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-4c136472-f8c7-43a8-b4e0-c0f2a3c8deed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.780265 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-4c136472-f8c7-43a8-b4e0-c0f2a3c8deed service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.3287766
Jun 01 18:47:59.801046 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-06cd9ab9-0dbc-42b9-ae7c-2e665ff884be service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4734275
Jun 01 18:47:59.815502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7bccb37-9e8c-42fe-acf7-c5b2f8762af9 req-ccd0d3d9-5ef7-429f-9380-47b7d387bce1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.818071 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f7bccb37-9e8c-42fe-acf7-c5b2f8762af9 req-ccd0d3d9-5ef7-429f-9380-47b7d387bce1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 944 time: 0.5057211
Jun 01 18:47:59.857548 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-7f681537-1ea9-4c46-b72e-34c55f435066 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.858997 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-7f681537-1ea9-4c46-b72e-34c55f435066 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.4435592
Jun 01 18:47:59.871303 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-ca13e216-4edb-4d33-833d-973a190d1a48 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3811862
Jun 01 18:47:59.897269 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d0c13d3-58e3-40a9-a6b2-8572681bd988 req-e8404e79-ced3-4369-8d70-b8b84f8d55ef tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:47:59.898822 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1d0c13d3-58e3-40a9-a6b2-8572681bd988 req-e8404e79-ced3-4369-8d70-b8b84f8d55ef tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 944 time: 0.4441431
Jun 01 18:47:59.913329 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f7bccb37-9e8c-42fe-acf7-c5b2f8762af9 req-7a44120a-8ce1-46be-89ba-87ff661cef0b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0856929
Jun 01 18:47:59.945285 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:47:59.968944 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:47:59.980972 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1d0c13d3-58e3-40a9-a6b2-8572681bd988 req-ea91b8ce-2cf4-436d-81b3-045e40dcd9d3 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691521
Jun 01 18:47:59.995910 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Made reservation on behalf of 41638d3f0658425aa2f15362df9748a1 for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:47:59.999767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:00.234241 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Allocated IP 172.20.0.4 (d5efada3-47d7-493b-989f-ef9ac42a4054/3bc46f81-88af-4aba-902a-90b4633edf6a/55cf6496-724a-4c5e-bbb6-b4aeb491d9b2) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:00.237823 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe41009-37fc-4f09-9e46-009d4ad8e223 req-7aee9435-4831-4614-bc2c-75913cd76461 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:00.240324 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ebe41009-37fc-4f09-9e46-009d4ad8e223 req-7aee9435-4831-4614-bc2c-75913cd76461 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0928552
Jun 01 18:48:00.284676 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ebe41009-37fc-4f09-9e46-009d4ad8e223 req-5c85122f-476c-41cb-a81a-384e1facccfb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388837
Jun 01 18:48:00.340479 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e756b734-d650-4381-b0f6-e65586dbf25e req-0e9af8db-bff2-4dd1-b670-b57895545902 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:00.341929 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e756b734-d650-4381-b0f6-e65586dbf25e req-0e9af8db-bff2-4dd1-b670-b57895545902 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.1590359
Jun 01 18:48:00.433431 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-99f71e85-eaec-4639-80de-00d34fba9f81 req-fc3cd32c-6b76-4369-89eb-65a7c80c08de tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 210 time: 0.0429745
Jun 01 18:48:00.463149 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e756b734-d650-4381-b0f6-e65586dbf25e req-e398ad40-33c7-4d8b-b1ad-6792e760f530 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0735903
Jun 01 18:48:00.479747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:00.494839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Transition to ACTIVE for port object 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:00.517433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:00.524875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:00.590541 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:00.593652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:00.596072 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:00.633879 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:00.636970 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:00.668703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:00.669314 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:00.696213 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2048235
Jun 01 18:48:00.777209 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-a3b8560b-cb33-4435-8b0b-4f53f037ffb5 None None] Provisioning for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:00.781793 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-a3b8560b-cb33-4435-8b0b-4f53f037ffb5 None None] Provisioning complete for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:00.782170 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-a3b8560b-cb33-4435-8b0b-4f53f037ffb5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:00.837752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-a3b8560b-cb33-4435-8b0b-4f53f037ffb5 None None] Port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:48:01.119290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a7722a-4c7e-4194-8f92-c1565cd2310f req-36b61bf5-05f5-4ecd-97a2-e663492ec715 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:01.120835 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-67a7722a-4c7e-4194-8f92-c1565cd2310f req-36b61bf5-05f5-4ecd-97a2-e663492ec715 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 944 time: 0.0914619
Jun 01 18:48:01.166173 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3431c26a-9375-4257-b8c9-5bac4d806ee9 req-2c5bc473-0f24-4ac4-8d6d-f72a651af19a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:01.166173 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3431c26a-9375-4257-b8c9-5bac4d806ee9 req-2c5bc473-0f24-4ac4-8d6d-f72a651af19a tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 944 time: 0.0826633
Jun 01 18:48:01.180847 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-67a7722a-4c7e-4194-8f92-c1565cd2310f req-063ac92b-1e4a-42ad-b61b-886f63ef078f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0534716
Jun 01 18:48:01.220183 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3431c26a-9375-4257-b8c9-5bac4d806ee9 req-894b604a-1102-4d76-b0d0-0f595d5aacc6 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0500164
Jun 01 18:48:01.485477 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e95b9a0-b7bf-4a91-a05e-7fee8224fed1 req-86a1d8eb-070d-4d15-b8eb-232dbf770206 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:01.487091 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0e95b9a0-b7bf-4a91-a05e-7fee8224fed1 req-86a1d8eb-070d-4d15-b8eb-232dbf770206 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0972483
Jun 01 18:48:01.554890 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0e95b9a0-b7bf-4a91-a05e-7fee8224fed1 req-71a308c5-71f0-4536-88f8-3784f9dfb212 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618439
Jun 01 18:48:01.641569 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3360a8d8-26e9-4e29-96d8-3649089e0295 req-9ac8c993-01bb-4a9e-bcf5-09bde46d8fb2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:01.642315 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3360a8d8-26e9-4e29-96d8-3649089e0295 req-9ac8c993-01bb-4a9e-bcf5-09bde46d8fb2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:48:01.659335 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3360a8d8-26e9-4e29-96d8-3649089e0295 req-9ac8c993-01bb-4a9e-bcf5-09bde46d8fb2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:48:01.660848 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3360a8d8-26e9-4e29-96d8-3649089e0295 req-9ac8c993-01bb-4a9e-bcf5-09bde46d8fb2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 931 time: 0.1126294
Jun 01 18:48:01.715987 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3360a8d8-26e9-4e29-96d8-3649089e0295 req-8b834329-d133-4601-828e-e9aef11d011a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0465615
Jun 01 18:48:01.755971 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0070b18c-700c-44cc-a1f2-6686c00315f7 req-81f5e2a7-a2ec-4c0f-9af6-f1152e56ae57 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:01.757453 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0070b18c-700c-44cc-a1f2-6686c00315f7 req-81f5e2a7-a2ec-4c0f-9af6-f1152e56ae57 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0945787
Jun 01 18:48:01.805299 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0070b18c-700c-44cc-a1f2-6686c00315f7 req-94291679-2310-4a66-bb19-5163b5ae9259 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418272
Jun 01 18:48:02.415035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7daafa-160e-4ec0-8bf8-9f69aee251e1 req-7587e031-eb4b-456f-ac65-cf37e62d1d07 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:02.416819 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0f7daafa-160e-4ec0-8bf8-9f69aee251e1 req-7587e031-eb4b-456f-ac65-cf37e62d1d07 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 944 time: 0.0871851
Jun 01 18:48:02.441483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a971b1-33c8-4234-b615-dc3dd54c6e87 req-9484f699-747d-401a-9dd7-1da02efdbc5c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:02.443507 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-66a971b1-33c8-4234-b615-dc3dd54c6e87 req-9484f699-747d-401a-9dd7-1da02efdbc5c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 944 time: 0.1544173
Jun 01 18:48:02.461867 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0f7daafa-160e-4ec0-8bf8-9f69aee251e1 req-f117fda1-1ce6-4e42-a625-6ed899f84a25 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392060
Jun 01 18:48:02.486365 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-66a971b1-33c8-4234-b615-dc3dd54c6e87 req-db0bcbac-93c0-40ed-9bb3-ac6cac064314 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0372655
Jun 01 18:48:02.716123 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Request body: {'port': {'device_id': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:02.742565 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-212c2416-372d-4e52-b6fd-7650947f22fa service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0839443
Jun 01 18:48:02.901858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9048063-3fba-454f-817f-3bd0739a2659 req-460ae061-769d-4ad7-94be-7bb64f1a8958 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:02.903306 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9048063-3fba-454f-817f-3bd0739a2659 req-460ae061-769d-4ad7-94be-7bb64f1a8958 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.2140944
Jun 01 18:48:02.912851 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-2d6715e5-6a4b-452c-a53d-bf2d03a61281 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1619415
Jun 01 18:48:02.975350 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:03.018814 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-53071d2a-a764-420a-992e-ff2c7b48f66b service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3611970
Jun 01 18:48:03.037262 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9048063-3fba-454f-817f-3bd0739a2659 req-4a825c99-a274-42f7-b32c-d31b806405df tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1269791
Jun 01 18:48:03.065297 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84130741-bb50-4636-b8a8-34348311b9cd req-4d436262-5b52-4651-9e66-e680736e4db9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:03.066758 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-4d436262-5b52-4651-9e66-e680736e4db9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3913465
Jun 01 18:48:03.080208 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f776c88-fdb6-493a-9af8-d4ff01123d2c req-17df3595-2bf8-4a56-9d50-4a86263145e7 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1524239
Jun 01 18:48:03.191666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c9273d-9ec5-41d7-8253-34d6b40160e2 req-850f669c-c281-4398-a933-26be9475aab8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:03.196634 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c1c9273d-9ec5-41d7-8253-34d6b40160e2 req-850f669c-c281-4398-a933-26be9475aab8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 931 time: 0.3132432
Jun 01 18:48:03.253630 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574c0677-006d-4fa2-87de-7f4d5b3b93e5 req-983c766b-0787-498e-95f6-304f3df92ae2 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:03.262170 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-574c0677-006d-4fa2-87de-7f4d5b3b93e5 req-983c766b-0787-498e-95f6-304f3df92ae2 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.0901539
Jun 01 18:48:03.310713 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-574c0677-006d-4fa2-87de-7f4d5b3b93e5 req-12e25a01-03ed-4ee7-badc-db9460aa5b29 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0489299
Jun 01 18:48:03.365443 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c1c9273d-9ec5-41d7-8253-34d6b40160e2 req-89a7504e-32f7-4351-8b4d-cf4cd06e8f30 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1679401
Jun 01 18:48:03.383889 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-c9cfee83-cd3b-4e23-83a9-479b2e3a04a6 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3065186
Jun 01 18:48:03.604546 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-84130741-bb50-4636-b8a8-34348311b9cd req-60f33c03-8534-4e0a-9d77-b1b8f517af74 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1706357
Jun 01 18:48:03.657478 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d351a-a8ba-49a7-ba46-9008549696d7 req-1eeb8424-df51-45ee-9fbc-670e4935a776 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:03.658832 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bc7d351a-a8ba-49a7-ba46-9008549696d7 req-1eeb8424-df51-45ee-9fbc-670e4935a776 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 944 time: 0.0903442
Jun 01 18:48:03.705047 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bc7d351a-a8ba-49a7-ba46-9008549696d7 req-9589a4d4-7e7e-4afa-bc1b-c89c0d86804f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399449
Jun 01 18:48:03.714967 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:03.724326 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:03.747378 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Transition to ACTIVE for port object 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:03.757451 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:03.769267 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb831446-0dc7-4e69-a371-4db047ce00fe req-d756db5e-c133-4260-923e-8c2e740bc8e8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:03.770781 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fb831446-0dc7-4e69-a371-4db047ce00fe req-d756db5e-c133-4260-923e-8c2e740bc8e8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 944 time: 0.1653893
Jun 01 18:48:03.772651 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:03.970585 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:03.979609 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:04.015523 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fb831446-0dc7-4e69-a371-4db047ce00fe req-a69fd495-db77-4709-bacf-f5858ec217f8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2080266
Jun 01 18:48:04.057225 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Attempting to bind port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:04.057617 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Attempting to bind port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:04.057946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Attempting to bind port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:04.062567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 on network d5efada3-47d7-493b-989f-ef9ac42a4054 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:48:04.062884 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Attempting to bind port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:04.068545 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 47, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:04.068885 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Checking segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:04.069265 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Bound using segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:04.069696 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Bound port: 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:04.070044 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:04.157741 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:04.161281 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:04.165258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:04.169881 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:04.240209 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f03a62a-a8ba-471f-9c93-343d956dc2fa req-0dc9174b-42e8-4dfd-8801-1d9fd57d064d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.242722 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f03a62a-a8ba-471f-9c93-343d956dc2fa req-0dc9174b-42e8-4dfd-8801-1d9fd57d064d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.0867441
Jun 01 18:48:04.294110 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f03a62a-a8ba-471f-9c93-343d956dc2fa req-65f09d8d-388f-4775-a143-e73cf0272881 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459707
Jun 01 18:48:04.303509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.304016 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:04.305392 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] 10.222.0.25 "PUT /v2.0/ports/55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 1093 time: 1.6288707
Jun 01 18:48:04.305854 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:04.308088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3bb44428-c53c-4f74-bd58-f26c629da1e6" -d '{"events": [{"name": "network-changed", "server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:04.337362 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:04.351721 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:04.410032 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24cfecbb-72c5-44d6-890a-a458de96885c x-openstack-request-id: req-24cfecbb-72c5-44d6-890a-a458de96885c {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:04.410337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:04.410599 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-24cfecbb-72c5-44d6-890a-a458de96885c {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:04.411587 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'status': 'completed', 'code': 200}
Jun 01 18:48:04.464489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-0aa16344-e9f3-448d-97ac-3e3003f15a3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.466477 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-0aa16344-e9f3-448d-97ac-3e3003f15a3a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1096 time: 0.1087587
Jun 01 18:48:04.592614 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-57e6a352-953a-4a72-9561-8efbdb528fd3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 217 time: 0.1168566
Jun 01 18:48:04.647697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d55f36-d9e6-4b0c-992f-d9dec7111ba1 req-b7392256-3085-46cc-bc7a-2884217a0929 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.654835 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-18d55f36-d9e6-4b0c-992f-d9dec7111ba1 req-b7392256-3085-46cc-bc7a-2884217a0929 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.1441028
Jun 01 18:48:04.655403 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device d39deb11-706c-4a8b-a636-d8d69ede4926 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:04.704322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae1af3a-4f44-4030-a657-6f7ea03adecd req-5c2d2fcd-a7d7-46db-bae6-f95f13517536 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.705891 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9ae1af3a-4f44-4030-a657-6f7ea03adecd req-5c2d2fcd-a7d7-46db-bae6-f95f13517536 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1467080
Jun 01 18:48:04.710193 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-934f942f-4532-4f38-b0a5-f21f225a10ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.711546 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-934f942f-4532-4f38-b0a5-f21f225a10ee service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.1121004
Jun 01 18:48:04.715450 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-18d55f36-d9e6-4b0c-992f-d9dec7111ba1 req-3fd04f81-3959-4885-a014-454a77a7fa70 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0596123
Jun 01 18:48:04.823748 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9ae1af3a-4f44-4030-a657-6f7ea03adecd req-af3a2e70-b304-44aa-af92-08e8a294853e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1090424
Jun 01 18:48:04.827717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port d39deb11-706c-4a8b-a636-d8d69ede4926 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:04.838180 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port d39deb11-706c-4a8b-a636-d8d69ede4926 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:04.838574 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:04.850204 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1e7f1de4-0287-4c7e-96e6-bcbcfe0e56ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:04.852274 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-1e7f1de4-0287-4c7e-96e6-bcbcfe0e56ab service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1230569
Jun 01 18:48:05.008158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545af5cf-7500-473a-9136-aeee392e6315 req-a402c81f-b7a8-4127-853f-260816aebada tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:05.015111 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-545af5cf-7500-473a-9136-aeee392e6315 req-a402c81f-b7a8-4127-853f-260816aebada tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 944 time: 0.1054101
Jun 01 18:48:05.033761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.034794 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 32952) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:05.048497 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-e0ed2dc1-b855-4e46-8b94-1ff844fa3fd5 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1822135
Jun 01 18:48:05.102419 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:05.127393 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-545af5cf-7500-473a-9136-aeee392e6315 req-f8cb4655-c9b2-45f9-9333-345611d0b816 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1113119
Jun 01 18:48:05.217126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=d39deb11-706c-4a8b-a636-d8d69ede4926,segment=NetworkSegment(ade580c3-c29b-43be-bce2-a56993c1cb04),segment_id=ade580c3-c29b-43be-bce2-a56993c1cb04)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:05.242139 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.243294 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 7a59828a-57a1-4f2b-9392-36cb6d568256 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:05.251130 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.272452 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:05.278102 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Usage tracker for resource:security_group_rule and tenant:51282cd8336c4284be2bf6584dd96b4d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:05.283058 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:05.293231 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:05.329371 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-567ec131-24e1-4dc9-baed-66c341328aa1 req-f6840da1-63bd-40e2-b907-cb61fb42b2f1 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2673333
Jun 01 18:48:05.375954 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f8b7ea-6d65-44d9-86ac-728bc73e0f50 req-e8e71272-eb3b-4581-90c5-8c9490e7aff6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:05.383286 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-09f8b7ea-6d65-44d9-86ac-728bc73e0f50 req-e8e71272-eb3b-4581-90c5-8c9490e7aff6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 944 time: 0.2094963
Jun 01 18:48:05.424586 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:05.442850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.452017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.470522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f435efb8-3570-45d5-9c1e-8d44711ba1e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:05.498031 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-09f8b7ea-6d65-44d9-86ac-728bc73e0f50 req-632f3237-edce-4241-9f9c-0302e7662ece tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1138473
Jun 01 18:48:05.516208 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59d33292-8d6a-43cd-87c3-c07eabe8f15e" -d '{"events": [{"server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "name": "network-vif-plugged", "status": "completed", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:05.533529 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-f4bd2d5b-449a-4df3-a114-05f7085ab610 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:05.535144 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-f4bd2d5b-449a-4df3-a114-05f7085ab610 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1096 time: 0.1318967
Jun 01 18:48:05.637850 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:05.643408 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:05.650781 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 7a59828a-57a1-4f2b-9392-36cb6d568256 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:05.661483 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 7a59828a-57a1-4f2b-9392-36cb6d568256 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:05.664633 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.712531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-d91dc19f-615a-402b-8c81-48a40be1445d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:05.714529 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-d91dc19f-615a-402b-8c81-48a40be1445d service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.1720052
Jun 01 18:48:05.717085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=babff02b-c93a-42a9-b3e3-3498b0d57c52,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:05.731582 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:05.742097 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=51282cd8336c4284be2bf6584dd96b4d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7062342
Jun 01 18:48:05.750777 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 32988) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:05.756508 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-980874c6-9cfd-45fb-8fa5-57881e020efc x-openstack-request-id: req-980874c6-9cfd-45fb-8fa5-57881e020efc {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:05.757177 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "name": "network-vif-plugged", "status": "completed", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:05.757493 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-980874c6-9cfd-45fb-8fa5-57881e020efc {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:05.758077 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926', 'code': 200}
Jun 01 18:48:05.826944 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-d194da67-9763-4902-a991-c8c9863c4c5d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 217 time: 0.1044118
Jun 01 18:48:05.853791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02dd663-3a8b-4249-a722-c76944a4d8d2 req-00ce4ad3-6aa4-4571-ae55-30778eace28e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:05.855627 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a02dd663-3a8b-4249-a722-c76944a4d8d2 req-00ce4ad3-6aa4-4571-ae55-30778eace28e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 943 time: 0.3465390
Jun 01 18:48:05.892636 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.937538 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a02dd663-3a8b-4249-a722-c76944a4d8d2 req-71b9e2bb-a42b-492e-8c42-706321058db6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0735230
Jun 01 18:48:05.937735 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.957476 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.980687 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=7a59828a-57a1-4f2b-9392-36cb6d568256,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:05.989406 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:05.991972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:06.030281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.039308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-747b8d0d-52e3-415a-b299-78c26cff3dd7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:06.054212 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=babff02b-c93a-42a9-b3e3-3498b0d57c52,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:06.057882 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:06.066324 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.072910 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/babff02b-c93a-42a9-b3e3-3498b0d57c52 HTTP/1.1" status: 204  len: 168 time: 0.3193493
Jun 01 18:48:06.078583 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-644768ab-aaf0-4cc9-8faf-f1696940b37d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.087674 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-644768ab-aaf0-4cc9-8faf-f1696940b37d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.2503619
Jun 01 18:48:06.090916 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:06.094994 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:06.206174 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c658057-3149-45d0-b54c-7bf0f7c3d36d req-f723a645-505d-4249-8685-d603854d3ab8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.213756 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c658057-3149-45d0-b54c-7bf0f7c3d36d req-f723a645-505d-4249-8685-d603854d3ab8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 944 time: 0.2991083
Jun 01 18:48:06.243226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-efaee249-f69c-4525-975d-75c7cbf9df2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.245487 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-efaee249-f69c-4525-975d-75c7cbf9df2c service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 1098 time: 0.2636683
Jun 01 18:48:06.257233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08254a09-7492-40a7-b9e2-b9b86ab0a77a req-6e33a81c-ed6b-44a6-b5fe-88238c8a1781 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.263714 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08254a09-7492-40a7-b9e2-b9b86ab0a77a req-6e33a81c-ed6b-44a6-b5fe-88238c8a1781 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1230054
Jun 01 18:48:06.286828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.303475 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c658057-3149-45d0-b54c-7bf0f7c3d36d req-7cae0a2c-bbe1-4da2-8275-74254bc15d99 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0887277
Jun 01 18:48:06.333167 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08254a09-7492-40a7-b9e2-b9b86ab0a77a req-dc5ebb95-89a8-4488-9830-6725d4cae98a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0683599
Jun 01 18:48:06.336898 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-06302bbb-9c57-459b-b6d7-7afb986495e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.338135 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-06302bbb-9c57-459b-b6d7-7afb986495e5 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2322383
Jun 01 18:48:06.340858 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:06.381171 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Usage tracker for resource:security_group_rule and tenant:cb2708f843114f01b6e83a653123611e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:06.386579 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:06.405669 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:06.476178 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33020) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:06.627867 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.678072 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:06.681355 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 176d8ea4-da6f-4ccc-b7e0-f05371988c98 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:48:06.702765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Usage tracker for resource:security_group_rule and tenant:fa0e54e1d82c4e5f95df0e6d0ac2849f is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:06.708332 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-eb08550e-cbc6-477d-bcc9-0796f43b14ae service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3593495
Jun 01 18:48:06.709179 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:06.718705 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:06.841741 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:06.855039 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '176d8ea4-da6f-4ccc-b7e0-f05371988c98', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'port_id': '176d8ea4-da6f-4ccc-b7e0-f05371988c98', 'mac_address': 'fa:16:3e:f5:b2:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:48:06.870357 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8226f76c-86f2-476f-a8bb-81da6161b029 req-6985ea71-eba7-4bcd-a352-bfc602aff978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.872438 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8226f76c-86f2-476f-a8bb-81da6161b029 req-6985ea71-eba7-4bcd-a352-bfc602aff978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.0869968
Jun 01 18:48:06.880217 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee968621-0797-4f07-87e3-381ed529994d req-7a35846f-2c74-4afe-b14f-5d4fc8c35f92 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:06.881815 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ee968621-0797-4f07-87e3-381ed529994d req-7a35846f-2c74-4afe-b14f-5d4fc8c35f92 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.4515872
Jun 01 18:48:06.912020 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.912249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.922001 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8226f76c-86f2-476f-a8bb-81da6161b029 req-299f82bc-990e-4ab1-8abd-a8d356cf3b63 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427985
Jun 01 18:48:06.930701 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 176d8ea4-da6f-4ccc-b7e0-f05371988c98 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:06.942662 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.949000 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:06.952928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:06.953939 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1f190c93-827a-4047-8b5a-f63e6b4ba061 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:48:06.957117 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:06.960720 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:07.019181 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8ba9d9a0-85e2-4713-a383-cffce4aac0f3 req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.7660549
Jun 01 18:48:07.029666 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bb44428-c53c-4f74-bd58-f26c629da1e6 req-667a24d9-d551-40d2-94d7-8bb38fe2f186 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3089216
Jun 01 18:48:07.035624 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ee968621-0797-4f07-87e3-381ed529994d req-184163e1-5e36-4a4d-a76b-972d7becd535 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1390798
Jun 01 18:48:07.039096 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=9f46b18a-3799-4584-8567-2cfe972caaf8,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.045956 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.072232 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.075476 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.084519 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.089951 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.100541 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3377cf1d-fde2-475d-9562-bc1e1b225eea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:07.144927 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50991f54-0068-4dc3-af07-488aee038595,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.149214 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec8afd5e-b015-4a69-b645-3df1ac9e5658 req-d9bdf199-659e-403d-8871-71a033f36cc6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:07.150852 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec8afd5e-b015-4a69-b645-3df1ac9e5658 req-d9bdf199-659e-403d-8871-71a033f36cc6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 944 time: 0.0843930
Jun 01 18:48:07.153272 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=fa0e54e1d82c4e5f95df0e6d0ac2849f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6759796
Jun 01 18:48:07.154097 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.154536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33030) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:07.195216 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:07.212115 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'port_id': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'mac_address': 'fa:16:3e:73:d7:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 61, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:48:07.215683 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec8afd5e-b015-4a69-b645-3df1ac9e5658 req-625862be-f186-47f4-9b2c-bb38a64cae7b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0552270
Jun 01 18:48:07.240859 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.268155 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.271855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.289308 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f190c93-827a-4047-8b5a-f63e6b4ba061 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:07.312232 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:07.317725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.318689 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b54280f9-3b4c-49b4-b5a4-610e3328b1af details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:48:07.320955 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:07.336621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.342836 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:07.357130 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50991f54-0068-4dc3-af07-488aee038595,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.361181 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.368101 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.373990 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/50991f54-0068-4dc3-af07-488aee038595 HTTP/1.1" status: 204  len: 168 time: 0.2169840
Jun 01 18:48:07.426096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:07.443000 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af', 'network_id': '7c0d1d41-a033-4bad-b3c8-a15d3b31242e', 'port_id': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af', 'mac_address': 'fa:16:3e:14:ef:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e5e3f92a-adf7-40b8-b630-052c45a2db57', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:48:07.444694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.448340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.516026 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.543732 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b54280f9-3b4c-49b4-b5a4-610e3328b1af {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:07.563148 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:07.567634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194611d0-1df1-4ce8-8711-b310801871e9 req-c9a84f4e-a15e-403c-b180-736d4af1b21b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:07.569294 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-194611d0-1df1-4ce8-8711-b310801871e9 req-c9a84f4e-a15e-403c-b180-736d4af1b21b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 945 time: 0.1037652
Jun 01 18:48:07.570369 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:07.573096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-42e84f32-45f4-42bf-99d5-0741dcdaf3ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:07.612147 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29765b83-f976-421b-8e31-45550fc73eca req-59d5e86a-c171-49f9-9c7b-9514e3e63e37 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:07.629254 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-29765b83-f976-421b-8e31-45550fc73eca req-59d5e86a-c171-49f9-9c7b-9514e3e63e37 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1340261
Jun 01 18:48:07.633688 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-194611d0-1df1-4ce8-8711-b310801871e9 req-fb70664a-b1ad-4735-a9a7-2298e6427b59 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0580175
Jun 01 18:48:07.678888 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:07.682158 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-29765b83-f976-421b-8e31-45550fc73eca req-c88ba45c-6096-4b0c-b0d5-bad830f5d261 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513029
Jun 01 18:48:07.682302 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:07.759290 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:07.761999 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-152eac8e-3cfb-45f9-b8b8-550090889461" -d '{"events": [{"server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "name": "network-vif-plugged", "status": "completed", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:07.821752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2da7d2f9-a47b-4405-b3de-32760462dcf0 x-openstack-request-id: req-2da7d2f9-a47b-4405-b3de-32760462dcf0 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:07.821913 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "name": "network-vif-plugged", "status": "completed", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:07.822336 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-2da7d2f9-a47b-4405-b3de-32760462dcf0 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:07.822913 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256', 'code': 200}
Jun 01 18:48:07.935038 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['176d8ea4-da6f-4ccc-b7e0-f05371988c98'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:08.008556 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['1f190c93-827a-4047-8b5a-f63e6b4ba061'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:08.038927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['b54280f9-3b4c-49b4-b5a4-610e3328b1af'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:08.105220 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7cdc6f7-0667-4796-a22b-8ef4a364ce68 req-10c9c6e5-3bcf-4d10-acbb-8a7ed8063f97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.107004 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a7cdc6f7-0667-4796-a22b-8ef4a364ce68 req-10c9c6e5-3bcf-4d10-acbb-8a7ed8063f97 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 1098 time: 0.1106479
Jun 01 18:48:08.191199 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e1a6d4-aff4-4890-90bb-94f9b7f45e8b req-4e84e6f5-85c6-4f07-9575-254632c9655b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.199089 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-95e1a6d4-aff4-4890-90bb-94f9b7f45e8b req-4e84e6f5-85c6-4f07-9575-254632c9655b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.1093678
Jun 01 18:48:08.263943 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-95e1a6d4-aff4-4890-90bb-94f9b7f45e8b req-0062e8f3-356e-4038-8052-92bb0e86a930 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0634744
Jun 01 18:48:08.316190 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-a7cdc6f7-0667-4796-a22b-8ef4a364ce68 req-567b73c7-b3c6-492e-acd8-64d121d66d45 service neutron] Synchronizing usage tracker for tenant:cb2708f843114f01b6e83a653123611e on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:48:08.401408 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-a7cdc6f7-0667-4796-a22b-8ef4a364ce68 req-567b73c7-b3c6-492e-acd8-64d121d66d45 service neutron] Unset dirty status for tenant:cb2708f843114f01b6e83a653123611e on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:48:08.410678 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a7cdc6f7-0667-4796-a22b-8ef4a364ce68 req-567b73c7-b3c6-492e-acd8-64d121d66d45 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2892115
Jun 01 18:48:08.485889 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd60d86-3c94-4de4-9d59-d47264b66d02 req-47f285f5-8b7e-4341-803c-44bcf544026d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.488340 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2cd60d86-3c94-4de4-9d59-d47264b66d02 req-47f285f5-8b7e-4341-803c-44bcf544026d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.2750072
Jun 01 18:48:08.581280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8900b81-2398-4a38-9256-55f151586186 req-8c27a373-0df8-4ccb-baac-b1f9ba1be282 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.596464 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8900b81-2398-4a38-9256-55f151586186 req-8c27a373-0df8-4ccb-baac-b1f9ba1be282 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 944 time: 0.2182806
Jun 01 18:48:08.623257 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2cd60d86-3c94-4de4-9d59-d47264b66d02 req-4247dff1-10be-4ee4-9324-a7fb28b2005c tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1185658
Jun 01 18:48:08.652759 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8900b81-2398-4a38-9256-55f151586186 req-0b8430e2-6d1c-4c66-82d4-33c65382f184 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0549004
Jun 01 18:48:08.679914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:48:08.932333 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139da7b2-b537-4472-88cc-ec91f2102217 req-1d910da4-22d0-4ed3-b84d-c719c580f2a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.933289 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:08.946763 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-139da7b2-b537-4472-88cc-ec91f2102217 req-1d910da4-22d0-4ed3-b84d-c719c580f2a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 945 time: 0.1467352
Jun 01 18:48:08.948147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:48:08.967338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a6736be-6e01-4d3d-8575-86f69da29c65 req-f1ad601e-eff3-499f-87b7-06bdda2f1843 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:08.970242 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7a6736be-6e01-4d3d-8575-86f69da29c65 req-f1ad601e-eff3-499f-87b7-06bdda2f1843 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1270597
Jun 01 18:48:09.009563 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-139da7b2-b537-4472-88cc-ec91f2102217 req-7508011d-516f-4797-a3de-263e54866e30 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0614092
Jun 01 18:48:09.018689 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.022555 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33096) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:09.039049 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.055839 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7a6736be-6e01-4d3d-8575-86f69da29c65 req-1b5a4c3a-30d7-4851-a0f5-133554773574 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0799391
Jun 01 18:48:09.063334 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:09.082447 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:09.089243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.091280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:09.161230 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:09.165049 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:09.190754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.206318 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:09.210912 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Usage tracker for resource:security_group_rule and tenant:3e50b5f195dc4bdcb674ca160124de3e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:09.213825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:09.220673 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:09.319813 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.324124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.331867 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:09.372770 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=3e50b5f195dc4bdcb674ca160124de3e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3480070
Jun 01 18:48:09.373669 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f849f404-b6ff-4dfd-a7dc-bc138ea16241,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:09.375452 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33106) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:09.381199 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:09.440809 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.467375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3391c0-a960-452c-bade-1c795891369f req-3a1fdb5b-c849-4e3c-b361-15b4c03225e2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:09.469122 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f3391c0-a960-452c-bade-1c795891369f req-3a1fdb5b-c849-4e3c-b361-15b4c03225e2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.0867546
Jun 01 18:48:09.469707 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.518027 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f3391c0-a960-452c-bade-1c795891369f req-824ee60b-e286-4d2e-be28-997d98ff927a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427816
Jun 01 18:48:09.524643 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:09.527728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.532959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:09.548351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f849f404-b6ff-4dfd-a7dc-bc138ea16241,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:09.556437 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.560083 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/f849f404-b6ff-4dfd-a7dc-bc138ea16241 HTTP/1.1" status: 204  len: 168 time: 0.1805329
Jun 01 18:48:09.560083 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.560083 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.560083 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.560501 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.562386 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.562764 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.563105 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.563456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.563801 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.564137 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.564503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.564844 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:09.573700 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:09.872602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3282ca-b33b-41fd-861c-f51bb7c4c0b5 req-baf5f54d-f080-41ab-b577-ec09398c55e6 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:09.875456 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3a3282ca-b33b-41fd-861c-f51bb7c4c0b5 req-baf5f54d-f080-41ab-b577-ec09398c55e6 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.1032312
Jun 01 18:48:09.891579 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d92264b-5ea9-4c45-9135-e1c28aa823cc req-04a5461f-de61-49c0-b038-07550e8c972c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:09.893299 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1d92264b-5ea9-4c45-9135-e1c28aa823cc req-04a5461f-de61-49c0-b038-07550e8c972c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 944 time: 0.1048088
Jun 01 18:48:09.931165 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33122) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:09.949959 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1d92264b-5ea9-4c45-9135-e1c28aa823cc req-78e42106-3e2b-4ba6-9373-8f3d9965d060 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488038
Jun 01 18:48:09.958956 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3a3282ca-b33b-41fd-861c-f51bb7c4c0b5 req-fa49a420-b5fa-4093-be84-5f1e8e1cc6e6 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0768478
Jun 01 18:48:09.961922 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:09.979061 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:09.983020 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Usage tracker for resource:security_group_rule and tenant:0e78bfb5bfee43bea38576184c0e4202 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:09.986018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:09.992610 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:10.090310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.095042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.107756 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bab2605a-e123-43b5-bd44-2b3007a14c67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:10.161516 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=0e78bfb5bfee43bea38576184c0e4202&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2286124
Jun 01 18:48:10.162889 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33132) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:10.173630 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6414d83b-f937-4be9-ab40-9278ca5fc515,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:10.179440 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:10.237019 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb3b4d2-5188-4f9f-a890-5f097e7be6c0 req-6424735b-5cdf-4dc9-8509-467dd2333a5c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:10.238606 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-adb3b4d2-5188-4f9f-a890-5f097e7be6c0 req-6424735b-5cdf-4dc9-8509-467dd2333a5c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 945 time: 0.1005712
Jun 01 18:48:10.284502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.289614 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-adb3b4d2-5188-4f9f-a890-5f097e7be6c0 req-b77ebb61-aa0b-4467-aca6-6bf6ed251a87 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424535
Jun 01 18:48:10.316239 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.349864 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b307c30f-470d-4c67-9e0b-baa8934037be req-604fe7c7-5a48-45c3-8149-8ba53e49bf78 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:10.351355 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b307c30f-470d-4c67-9e0b-baa8934037be req-604fe7c7-5a48-45c3-8149-8ba53e49bf78 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 944 time: 0.1571138
Jun 01 18:48:10.425246 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b307c30f-470d-4c67-9e0b-baa8934037be req-6cb93f10-29f5-4497-840a-8d985049aef9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0655794
Jun 01 18:48:10.434906 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.444319 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1751b17d-093e-422a-8710-0c6d5eaf6fe1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:10.456821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6414d83b-f937-4be9-ab40-9278ca5fc515,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:10.478518 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:10.494594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:10.496011 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6414d83b-f937-4be9-ab40-9278ca5fc515 HTTP/1.1" status: 204  len: 168 time: 0.3321805
Jun 01 18:48:10.714848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2e742f2-ed3c-4205-9737-e5ab55fce098 req-b9b5cb50-4aa3-4a15-901c-7bf298d5a20d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:10.716285 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2e742f2-ed3c-4205-9737-e5ab55fce098 req-b9b5cb50-4aa3-4a15-901c-7bf298d5a20d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.0882685
Jun 01 18:48:10.760816 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2e742f2-ed3c-4205-9737-e5ab55fce098 req-edd2dfc9-4ecb-4f68-9e38-80e3e546cdb8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389941
Jun 01 18:48:11.150368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b44472-943f-4ec2-a073-60df573bc885 req-143f699f-b638-499c-a9d3-8800afc76967 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:11.157452 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-35b44472-943f-4ec2-a073-60df573bc885 req-143f699f-b638-499c-a9d3-8800afc76967 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 944 time: 0.0965109
Jun 01 18:48:11.214430 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-35b44472-943f-4ec2-a073-60df573bc885 req-7ef9f5a2-4a6f-4610-9adf-19c1b27e0936 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0561097
Jun 01 18:48:11.243794 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b54280f9-3b4c-49b4-b5a4-610e3328b1af up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:11.309891 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port b54280f9-3b4c-49b4-b5a4-610e3328b1af completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:11.314590 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port b54280f9-3b4c-49b4-b5a4-610e3328b1af triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:11.314995 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.444887 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.475081 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:11.477618 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d64f155-3bc0-4d8a-b6f6-f16235c3f2bc" -d '{"events": [{"server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "name": "network-vif-plugged", "status": "completed", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:11.487427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:11.493685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.494686 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1f190c93-827a-4047-8b5a-f63e6b4ba061 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:11.506979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3257150-8612-4b03-b3b9-98c2272e7c21 req-74e62c09-fbff-4507-9c99-7027ec6c19d9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:11.508577 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e3257150-8612-4b03-b3b9-98c2272e7c21 req-74e62c09-fbff-4507-9c99-7027ec6c19d9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 945 time: 0.1037083
Jun 01 18:48:11.523915 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:11.588742 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e3257150-8612-4b03-b3b9-98c2272e7c21 req-d94df82d-2454-4b00-9303-0b356d66700e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0656481
Jun 01 18:48:11.621358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:11.634836 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.635903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.636542 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.637121 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.637665 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.638510 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.639500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.640603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.641325 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.642212 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.642847 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.643501 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:11.649101 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:11.657305 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 1f190c93-827a-4047-8b5a-f63e6b4ba061 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:11.665990 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 1f190c93-827a-4047-8b5a-f63e6b4ba061 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:11.666544 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.713360 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8399833f-61c0-4911-a699-bea6444041a1 x-openstack-request-id: req-8399833f-61c0-4911-a699-bea6444041a1 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:11.713675 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "name": "network-vif-plugged", "status": "completed", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:11.713933 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-8399833f-61c0-4911-a699-bea6444041a1 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:11.714657 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af', 'code': 200}
Jun 01 18:48:11.718071 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db13b827-fd78-45c9-bc2c-bfe233fbe9bc req-df37313b-f83a-4c3b-a944-0e4d8c2ac59f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:11.720997 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-db13b827-fd78-45c9-bc2c-bfe233fbe9bc req-df37313b-f83a-4c3b-a944-0e4d8c2ac59f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 944 time: 0.1227760
Jun 01 18:48:11.794086 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-db13b827-fd78-45c9-bc2c-bfe233fbe9bc req-077654a9-269a-4939-a76e-9cecb30cc133 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0681467
Jun 01 18:48:11.820578 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.865869 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:11.870458 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:11.871416 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:11.901542 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b3ad63ca-39c9-42c7-be5a-a7e0a1b5ac8c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:11.989507 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:11.993829 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:12.003391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:12.008211 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:12.008635 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.130338 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.164324 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:12.168111 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.168984 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 176d8ea4-da6f-4ccc-b7e0-f05371988c98 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:12.192116 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:12.288055 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:12.291756 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:12.302215 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:12.307243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:12.307676 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.424780 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.452890 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09aad9ec-0594-4694-a177-d9b638ec2a39 req-0ebce13b-ff6e-440b-b426-79c734d7c191 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:12.454834 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-09aad9ec-0594-4694-a177-d9b638ec2a39 req-0ebce13b-ff6e-440b-b426-79c734d7c191 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 944 time: 0.0882313
Jun 01 18:48:12.458191 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:12.462412 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:12.464227 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:12.505647 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-09aad9ec-0594-4694-a177-d9b638ec2a39 req-ccc192a7-e4f1-42a6-8a6a-54c7957b8431 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437431
Jun 01 18:48:12.536067 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:12.539024 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:12.790756 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864d394c-5ffd-4c8f-80d1-166af786dfe1 req-a855832f-43c4-463b-8520-198f1b24c7e1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:12.792204 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-864d394c-5ffd-4c8f-80d1-166af786dfe1 req-a855832f-43c4-463b-8520-198f1b24c7e1 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0820668
Jun 01 18:48:12.841285 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-864d394c-5ffd-4c8f-80d1-166af786dfe1 req-19e8eb9f-5277-44f0-abdf-f5d1339a8254 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434458
Jun 01 18:48:12.987619 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43991f57-db9a-4509-8475-58e756b18d23 req-314d059f-a9d9-4658-870b-d559e9b8984d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:12.989575 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-43991f57-db9a-4509-8475-58e756b18d23 req-314d059f-a9d9-4658-870b-d559e9b8984d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0815756
Jun 01 18:48:13.034181 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-43991f57-db9a-4509-8475-58e756b18d23 req-6aadc4ee-e693-4e64-ab5f-87a5e574a0d8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390120
Jun 01 18:48:13.225281 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:48:13.385909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829bb8f0-30a0-4333-983c-28e78e70f53c req-084bf2d7-874e-4947-954c-7c5daf7523e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:13.387364 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-829bb8f0-30a0-4333-983c-28e78e70f53c req-084bf2d7-874e-4947-954c-7c5daf7523e8 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.0696890
Jun 01 18:48:13.429579 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-829bb8f0-30a0-4333-983c-28e78e70f53c req-1edac0b1-6dcc-490c-bcc5-ba057fac8e7a service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0346441
Jun 01 18:48:13.693245 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60d1484-1f1b-4847-9aa8-99d6d7a58313 req-b7a218ff-f3c0-4682-a69d-47eca8fc738b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:13.694691 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f60d1484-1f1b-4847-9aa8-99d6d7a58313 req-b7a218ff-f3c0-4682-a69d-47eca8fc738b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0816300
Jun 01 18:48:13.715691 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061'}, {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}, {'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:13.718216 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a4d7aab-f86a-430a-934c-54ef3d32420d" -d '{"events": [{"server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "name": "network-vif-plugged", "status": "completed", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061"}, {"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}, {"server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "name": "network-vif-plugged", "status": "completed", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:13.751324 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f60d1484-1f1b-4847-9aa8-99d6d7a58313 req-1f6ac736-afea-4e7d-af9f-55a5d969beed tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0508001
Jun 01 18:48:13.780292 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef963b1c-bc8f-4bdb-864b-81f0bdcb4e62 x-openstack-request-id: req-ef963b1c-bc8f-4bdb-864b-81f0bdcb4e62 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:13.780632 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "name": "network-vif-plugged", "status": "completed", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061", "code": 200}, {"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "code": 200}, {"server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "name": "network-vif-plugged", "status": "completed", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:13.780895 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-ef963b1c-bc8f-4bdb-864b-81f0bdcb4e62 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:13.781322 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'code': 200}
Jun 01 18:48:13.781786 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'code': 200}
Jun 01 18:48:13.782072 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98', 'code': 200}
Jun 01 18:48:14.132063 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-61a9f2a2-ddd7-4186-90ab-08947c5f1226 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:14.164876 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f273c7-0721-46a0-a6f8-8b3d7fe6f19c req-ecf7bb22-ec89-4622-baac-39e9e6f8ad7a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:14.175433 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73f273c7-0721-46a0-a6f8-8b3d7fe6f19c req-ecf7bb22-ec89-4622-baac-39e9e6f8ad7a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1408432
Jun 01 18:48:14.382502 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73f273c7-0721-46a0-a6f8-8b3d7fe6f19c req-98cf0952-5412-4969-96a2-a9a2aaff351b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2056828
Jun 01 18:48:14.423595 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ec7f45-57eb-4733-8c29-a2238c485e9a req-c1a67323-83d3-4360-8b00-bda00c9ecbb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:14.439343 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379ae51a-7c4e-4a7c-8bc1-f7cac855f341 req-c29f00f0-58d4-4d9b-8133-f1ba81679fee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:14.443724 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-379ae51a-7c4e-4a7c-8bc1-f7cac855f341 req-c29f00f0-58d4-4d9b-8133-f1ba81679fee service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1098 time: 0.1521201
Jun 01 18:48:14.444535 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-97ec7f45-57eb-4733-8c29-a2238c485e9a req-c1a67323-83d3-4360-8b00-bda00c9ecbb5 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1099 time: 0.1627474
Jun 01 18:48:14.461693 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21a5c91a-458a-469d-8812-5c0c20fd646a req-21383b25-ff0d-4724-8b31-c5096e67dc9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:14.463640 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-21a5c91a-458a-469d-8812-5c0c20fd646a req-21383b25-ff0d-4724-8b31-c5096e67dc9f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1098 time: 0.4142022
Jun 01 18:48:14.538667 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-379ae51a-7c4e-4a7c-8bc1-f7cac855f341 req-6a472554-3455-412d-92af-6066e26c5c90 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0813146
Jun 01 18:48:14.622128 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-97ec7f45-57eb-4733-8c29-a2238c485e9a req-28d9fefd-51df-4fc0-9e3e-33c5c6194f2e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1631167
Jun 01 18:48:14.622633 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33282) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:14.637321 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-21a5c91a-458a-469d-8812-5c0c20fd646a req-18ea6e5c-2e82-4a22-82d8-a0767cb6423e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1160669
Jun 01 18:48:14.749091 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f25928-401f-4e78-8f39-e6bbfab5a93a req-1c9af826-19ad-4ad1-880e-d814eb536a06 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:14.750740 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-30f25928-401f-4e78-8f39-e6bbfab5a93a req-1c9af826-19ad-4ad1-880e-d814eb536a06 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1568246
Jun 01 18:48:14.808691 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-30f25928-401f-4e78-8f39-e6bbfab5a93a req-6fd386e0-dcd1-4f82-b76d-3994ec718cda tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0519116
Jun 01 18:48:14.851714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:14.874633 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:14.881619 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Usage tracker for resource:security_group_rule and tenant:1363cd76174d4b0ab6935dfaf3f1974c is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:14.885376 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:14.894801 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:14.994582 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:14.999877 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:15.010347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2a3a4871-606b-4936-b6a1-49a381753298 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:15.061070 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=1363cd76174d4b0ab6935dfaf3f1974c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4350290
Jun 01 18:48:15.062143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc098bd3-a72c-4eb4-915d-d696828b9eb4,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:15.063666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33308) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:15.070984 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.071504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.072171 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.072697 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.073719 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.074231 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.074898 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.075546 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.076039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.076590 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.076946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.077284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:15.120957 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:15.152956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:15.169384 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3153d5f-e492-4f2a-a4db-240982d67084 req-de10d641-2be8-4f50-92f5-c2a5bbee1e91 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:15.176579 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d3153d5f-e492-4f2a-a4db-240982d67084 req-de10d641-2be8-4f50-92f5-c2a5bbee1e91 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0947034
Jun 01 18:48:15.189796 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:15.220850 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d3153d5f-e492-4f2a-a4db-240982d67084 req-e0e7309b-5d95-4cda-bb86-a8ecf72f7fe3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429242
Jun 01 18:48:15.278411 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:15.283220 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:15.295344 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc098bd3-a72c-4eb4-915d-d696828b9eb4,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:15.298318 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:15.300226 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:15.301380 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/dc098bd3-a72c-4eb4-915d-d696828b9eb4 HTTP/1.1" status: 204  len: 168 time: 0.2361572
Jun 01 18:48:15.599514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db9793e-adea-45af-8768-2556d4a34486 req-74618540-b20c-49c3-9837-e5fd868966c5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:15.601023 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4db9793e-adea-45af-8768-2556d4a34486 req-74618540-b20c-49c3-9837-e5fd868966c5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0946090
Jun 01 18:48:15.658043 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4db9793e-adea-45af-8768-2556d4a34486 req-1337d493-9373-4a31-a457-8bf01bcd93ee tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0499680
Jun 01 18:48:16.028808 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c06f88-fe17-4ed4-af88-f000e27bd010 req-52699ed4-0cd1-4f57-b939-2fafde95c8ce tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:16.030541 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90c06f88-fe17-4ed4-af88-f000e27bd010 req-52699ed4-0cd1-4f57-b939-2fafde95c8ce tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0944452
Jun 01 18:48:16.085002 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90c06f88-fe17-4ed4-af88-f000e27bd010 req-4bea9465-5aac-4610-802f-62fb16512700 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0482306
Jun 01 18:48:16.469737 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a1ae7e-f227-4825-be39-adad388b8f68 req-c4c670b6-a337-45c4-a7be-50a29ebcb0a5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:16.470552 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e4a1ae7e-f227-4825-be39-adad388b8f68 req-c4c670b6-a337-45c4-a7be-50a29ebcb0a5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1081362
Jun 01 18:48:16.520817 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e4a1ae7e-f227-4825-be39-adad388b8f68 req-766b65a5-1e71-4ea2-8cbd-c0b2eaa3e13e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428576
Jun 01 18:48:16.711561 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d86cb7d7-ea31-46f7-ae36-cd35918e05c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:16.856241 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:16.872148 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-615bf7f3-5c4b-4836-845c-41cb38934f3d req-3abf8854-3be2-43b6-9caa-292923442095 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:16.874233 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-615bf7f3-5c4b-4836-845c-41cb38934f3d req-3abf8854-3be2-43b6-9caa-292923442095 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0879540
Jun 01 18:48:16.952627 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-615bf7f3-5c4b-4836-845c-41cb38934f3d req-78e73571-b245-49d4-842c-6511b085be59 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0701969
Jun 01 18:48:17.167122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-defd8e01-bcb4-4f60-8ac8-61c7255db3ff req-105b2a8c-5043-4f5a-ab66-06d43ba69d82 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:17.169259 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-defd8e01-bcb4-4f60-8ac8-61c7255db3ff req-105b2a8c-5043-4f5a-ab66-06d43ba69d82 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1025465
Jun 01 18:48:17.179189 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33418) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:17.184031 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'floatingip': {'port_id': '1f190c93-827a-4047-8b5a-f63e6b4ba061'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:17.225002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33422) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:17.366220 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.392810 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.409215 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:17.413747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Usage tracker for resource:security_group_rule and tenant:17281b4a6fcb4bf580f8e77226b3d673 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:17.416560 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:17.422441 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:17.508552 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.512386 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.521901 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0d8e1da9-e642-405e-b3df-a1704e0670c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:17.563515 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=17281b4a6fcb4bf580f8e77226b3d673&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3345244
Jun 01 18:48:17.563788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bcf79e-d167-4d29-ad5f-b84412a360fa req-68955382-676a-4dcf-8f58-8e5c8045ea6b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:17.563892 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91c1041c-a84c-4a5d-bc9f-ed892910874f,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:17.563966 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84bcf79e-d167-4d29-ad5f-b84412a360fa req-68955382-676a-4dcf-8f58-8e5c8045ea6b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.2545376
Jun 01 18:48:17.565895 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33432) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:17.570819 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:17.723466 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762c87fe-fc6b-4b59-8134-f845b71233fd req-da345201-6434-42b3-b5d1-fa9f9e7c2acd tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:17.725024 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-762c87fe-fc6b-4b59-8134-f845b71233fd req-da345201-6434-42b3-b5d1-fa9f9e7c2acd tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0891240
Jun 01 18:48:17.730291 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84bcf79e-d167-4d29-ad5f-b84412a360fa req-fb3e82da-e21a-4f2a-acf5-9e83593d9b3b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1527030
Jun 01 18:48:17.779894 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.783850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:17.789832 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-762c87fe-fc6b-4b59-8134-f845b71233fd req-3810a514-12e2-4e69-a2f3-60f9114816e9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0554657
Jun 01 18:48:17.939709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:18.276508 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-109a3a44-15b8-4cb2-883f-1c9e000f682e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:18.278217 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-109a3a44-15b8-4cb2-883f-1c9e000f682e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1098 time: 0.1606932
Jun 01 18:48:18.287395 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2786e5-1280-4268-8183-b025771df137 req-d3d0f64a-dcb1-4419-be92-fc5107be0c5d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:18.289761 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0c2786e5-1280-4268-8183-b025771df137 req-d3d0f64a-dcb1-4419-be92-fc5107be0c5d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1236708
Jun 01 18:48:18.310502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de76c76-cacc-4aa7-81c1-dde4a352a9da req-ffc5fe35-7169-4048-8ca1-4cf68d915f87 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:18.311981 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7de76c76-cacc-4aa7-81c1-dde4a352a9da req-ffc5fe35-7169-4048-8ca1-4cf68d915f87 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.4478960
Jun 01 18:48:18.334825 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33454) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:18.345428 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'floatingip': {'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:18.363898 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0c2786e5-1280-4268-8183-b025771df137 req-34fe5985-3da7-44ae-a784-b310bbbd235b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0661049
Jun 01 18:48:18.426761 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:18.487340 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:18.492779 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-84d3a511-9e0a-4188-ba8e-fa0d37d8c897 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:18.494609 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-84d3a511-9e0a-4188-ba8e-fa0d37d8c897 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.2012560
Jun 01 18:48:18.507756 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-084a78be-a2ce-48c1-95dc-613e33a42117 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:18.574861 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91c1041c-a84c-4a5d-bc9f-ed892910874f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:18.577933 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-4780cba1-57e0-4d72-97a3-1ea55610cc64 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98 HTTP/1.1" status: 200  len: 217 time: 0.0752969
Jun 01 18:48:18.584480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:18.593432 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:18.594543 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/91c1041c-a84c-4a5d-bc9f-ed892910874f HTTP/1.1" status: 204  len: 168 time: 1.0277362
Jun 01 18:48:18.678263 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-8093b51c-e053-4f52-b4aa-16680d15cfda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:18.679690 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-8093b51c-e053-4f52-b4aa-16680d15cfda service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0890763
Jun 01 18:48:18.698163 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.db.resource_extend [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 18:48:18.757668 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-054e4443-7858-4e1c-9108-20007c297f01 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0702538
Jun 01 18:48:18.885058 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:18.902223 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.033231 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-ec637008-5ce4-4fee-8e14-54bf00eb9bc0 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2673023
Jun 01 18:48:19.098710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33486) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:19.121001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.184319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:19.201491 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Usage tracker for resource:security_group_rule and tenant:d3fcc100ddf648098566d1d9a52971d2 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:19.201589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33490) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:19.203385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:19.212008 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:19.278057 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Floating IP 385a9467-d585-4da2-96b4-edcd5d86f8d8 associated. External IP: 172.27.0.22, port: 1f190c93-827a-4047-8b5a-f63e6b4ba061.
Jun 01 18:48:19.302067 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9f7cdd81-85fe-42a1-bb97-ae91981124b0 req-fe447798-d357-462d-88bf-f2a8c2c5ccdf service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2534616
Jun 01 18:48:19.373958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.378200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.383226 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.386805 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:19.425416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:19.432499 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=d3fcc100ddf648098566d1d9a52971d2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3300059
Jun 01 18:48:19.432499 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ad5ada2-8bac-4627-a02e-5947063ed774,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:19.433663 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33496) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:19.434914 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:19.435800 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Usage tracker for resource:security_group_rule and tenant:761ea60292d7460ea3eae3670c2644b7 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:19.438845 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:19.497472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.498033 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.517670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:19.526634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.583275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.596907 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bbd3f020-10d1-43c6-b915-15d96fabdc1b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:19.607632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ad5ada2-8bac-4627-a02e-5947063ed774,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:19.610238 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:19.623179 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:19.624409 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/4ad5ada2-8bac-4627-a02e-5947063ed774 HTTP/1.1" status: 204  len: 168 time: 0.1905282
Jun 01 18:48:19.944617 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f717f449-16f6-4265-8f88-c808f6d37583 req-0c86daea-0b1f-45fb-abad-9c2806914046 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:19.946097 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f717f449-16f6-4265-8f88-c808f6d37583 req-0c86daea-0b1f-45fb-abad-9c2806914046 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.4230340
Jun 01 18:48:19.951541 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.db.resource_extend [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 18:48:20.107151 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.109878 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:48:20.118027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.122060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.135058 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:20.148191 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.217739 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f717f449-16f6-4265-8f88-c808f6d37583 req-3ba3bc7f-260c-44de-8d8b-ca2bd62837d3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2016587
Jun 01 18:48:20.318225 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=761ea60292d7460ea3eae3670c2644b7&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1139023
Jun 01 18:48:20.320903 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33524) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:20.328736 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=698df607-ecb9-4ae2-92b6-d9038c7af90d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:20.343413 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:20.381792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.410114 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.463574 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.468271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:20.479178 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=698df607-ecb9-4ae2-92b6-d9038c7af90d,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:20.481583 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:20.486777 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.491462 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/698df607-ecb9-4ae2-92b6-d9038c7af90d HTTP/1.1" status: 204  len: 168 time: 0.1692564
Jun 01 18:48:20.519831 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Floating IP 574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd associated. External IP: 172.27.0.90, port: 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2.
Jun 01 18:48:20.575894 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:20.590006 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:20.612224 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:20.622426 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:20.624893 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd6ea90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:20.753899 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-98921629-49cd-4775-90d3-2f7ebbf987c0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "PUT /v2.0/floatingips/385a9467-d585-4da2-96b4-edcd5d86f8d8 HTTP/1.1" status: 200  len: 991 time: 3.5735555
Jun 01 18:48:20.757825 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:20.760288 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d57f564a-15d4-425e-a326-0e64470e99d4" -d '{"events": [{"name": "network-changed", "server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:20.877729 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49fc6348-108d-4338-ab06-b3a27a8628c8 x-openstack-request-id: req-49fc6348-108d-4338-ab06-b3a27a8628c8 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:20.878043 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:20.878332 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-49fc6348-108d-4338-ab06-b3a27a8628c8 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:20.878723 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'status': 'completed', 'code': 200}
Jun 01 18:48:20.962605 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:21.016677 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33552) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:21.019266 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:48:21.039482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.057036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:21.071385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Usage tracker for resource:security_group_rule and tenant:93bfb68cf92347c2ba57dd4e51641e66 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:21.074873 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:21.081118 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:21.250345 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.256315 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.270904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-35c1f446-6472-4909-96a8-5e89ea4aaad7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:21.319600 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d504aad3-4b24-4b4c-a026-c08dadb6f3f3,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:21.325379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:21.349665 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:21.354636 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=93bfb68cf92347c2ba57dd4e51641e66&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3359029
Jun 01 18:48:21.359803 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.364083 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33564) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:21.365310 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:21.404607 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:21.404607 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdeeedc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:21.453284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.468675 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e5802f30-191a-4551-bb72-b32bd676b6ad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "PUT /v2.0/floatingips/574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd HTTP/1.1" status: 200  len: 990 time: 3.1304419
Jun 01 18:48:21.482825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.506159 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd6ea90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '385a9467-d585-4da2-96b4-edcd5d86f8d8', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:73:d7:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:38Z', 'updated_at': '2021-06-01T18:48:18Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:21.511163 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:21.515174 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d984991-dbc4-447f-9481-67a67881d38b req-7e4e4885-26bc-487f-a7f5-7b4f6a7ff7d7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:21.521018 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6d984991-dbc4-447f-9481-67a67881d38b req-7e4e4885-26bc-487f-a7f5-7b4f6a7ff7d7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1266792
Jun 01 18:48:21.539795 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.542355 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:21.543306 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd6ea90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:21.546783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:21.560150 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d504aad3-4b24-4b4c-a026-c08dadb6f3f3,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:21.562782 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:21.563922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:21.565052 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/d504aad3-4b24-4b4c-a026-c08dadb6f3f3 HTTP/1.1" status: 204  len: 168 time: 0.1996918
Jun 01 18:48:21.596137 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6d984991-dbc4-447f-9481-67a67881d38b req-93d946aa-441b-4a36-91aa-a0d156be7c59 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698330
Jun 01 18:48:21.687369 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:21.786223 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:22.006772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33582) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:22.149790 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdeeedc0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.90', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:45Z', 'updated_at': '2021-06-01T18:48:19Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:22.150639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.154384 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:22.163932 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:22.164571 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdeeedc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:22.168325 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:22.172500 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Usage tracker for resource:security_group_rule and tenant:ee92834c9eeb42a2a0ad9f14cd9d50bd is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:22.175660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:22.181983 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:22.227353 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd6ea90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '385a9467-d585-4da2-96b4-edcd5d86f8d8', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:73:d7:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:38Z', 'updated_at': '2021-06-01T18:48:18Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:22.235876 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca53ee8d-ec36-43ad-a261-358101f02d8a None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '385a9467-d585-4da2-96b4-edcd5d86f8d8', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:73:d7:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:38Z', 'updated_at': '2021-06-01T18:48:18Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:22.317610 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.324989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.335623 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-838de429-132d-46ed-9642-456a2cf085a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:22.379118 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ee92834c9eeb42a2a0ad9f14cd9d50bd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3709962
Jun 01 18:48:22.381009 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6723b631-3ea0-47cf-b4a1-de338393812c,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:22.381836 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33596) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:22.382865 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:22.384607 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:22.476168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.518765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.526481 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ad68417-a384-4266-a68a-f1867cff2097 None None] New status for floating IP 385a9467-d585-4da2-96b4-edcd5d86f8d8: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:48:22.663963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.669996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ef32e418-fbc0-4ba9-a2fc-20e6a0c51abd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:22.692561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6723b631-3ea0-47cf-b4a1-de338393812c,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:22.695485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:22.703086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:22.706759 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6723b631-3ea0-47cf-b4a1-de338393812c HTTP/1.1" status: 204  len: 168 time: 0.3163853
Jun 01 18:48:22.720203 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-2193292a-1e29-420d-a521-06a0c7867afd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:22.721981 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-2193292a-1e29-420d-a521-06a0c7867afd service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1099 time: 0.1445534
Jun 01 18:48:22.880466 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:22.883606 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe9091c1-34e1-4da1-8245-bbbd90023916" -d '{"events": [{"name": "network-changed", "server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:22.963880 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03db97d4-670f-4005-979f-639db55dfe4f x-openstack-request-id: req-03db97d4-670f-4005-979f-639db55dfe4f {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:22.964091 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:22.964350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-03db97d4-670f-4005-979f-639db55dfe4f {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:22.964805 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'status': 'completed', 'code': 200}
Jun 01 18:48:22.974196 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-d554d394-c6c4-4b1d-9c48-bb47cb72e108 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:22.975749 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-d554d394-c6c4-4b1d-9c48-bb47cb72e108 service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.2461867
Jun 01 18:48:22.985837 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdeeedc0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.90', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:45Z', 'updated_at': '2021-06-01T18:48:19Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:22.993652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a327841-008a-4e9e-9ff0-cbfca8419c71 req-f05c0c0d-ff91-4147-a55c-633fa41ec77e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:22.994447 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04a9f583-1ecd-40a3-9acb-def6b732b53c None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.90', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:47:45Z', 'updated_at': '2021-06-01T18:48:19Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:23.001536 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3a327841-008a-4e9e-9ff0-cbfca8419c71 req-f05c0c0d-ff91-4147-a55c-633fa41ec77e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.2465906
Jun 01 18:48:23.239193 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3a327841-008a-4e9e-9ff0-cbfca8419c71 req-62da7c43-fde7-42d6-8219-3c2cff3a0f8d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2366424
Jun 01 18:48:23.258819 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-0b9b2c15-a6c7-4127-93b1-df81b6f13229 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 1001 time: 0.2552402
Jun 01 18:48:23.341073 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37855f4c-7dda-432c-959e-8db73e209a29 None None] New status for floating IP 574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd: ACTIVE {{(pid=98260) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:48:23.358036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-13c20ad2-541f-447f-82a3-3ab75970409c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:23.359642 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-13c20ad2-541f-447f-82a3-3ab75970409c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1098 time: 0.3540306
Jun 01 18:48:23.364344 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-f992cc9c-9177-4078-9c08-2a1982668adc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:23.366083 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-f992cc9c-9177-4078-9c08-2a1982668adc service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.0944169
Jun 01 18:48:23.400503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33640) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:23.429236 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.468315 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:23.475995 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Usage tracker for resource:security_group_rule and tenant:5754be352e9e4e2bb52e54bcc0655c25 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:23.486449 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:23.498423 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:23.606690 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-787092ed-a7bb-44a9-be73-c6c74e189c24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:23.608313 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-787092ed-a7bb-44a9-be73-c6c74e189c24 service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.2267685
Jun 01 18:48:23.610192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-4684caed-31e3-4418-8db6-6d365671abb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:23.611529 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-4684caed-31e3-4418-8db6-6d365671abb7 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2286720
Jun 01 18:48:23.622049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.628537 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.666326 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c8ab4b17-0aff-4ee8-ba51-139d2d0272cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:23.681142 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=5754be352e9e4e2bb52e54bcc0655c25&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2784965
Jun 01 18:48:23.682153 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33650) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:23.742036 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86c03e67-f3d0-4905-8003-78fdf39dd08d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:23.752939 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:23.794193 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.824398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.895360 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-cdb28a9d-e6af-4928-b83d-ec14bf37a983 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 998 time: 0.2719557
Jun 01 18:48:23.903914 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.909532 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-fada7dbc-ef5c-4c2c-bb1a-55cf0270673b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:23.947298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86c03e67-f3d0-4905-8003-78fdf39dd08d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:23.958631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:23.959741 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:23.963518 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/86c03e67-f3d0-4905-8003-78fdf39dd08d HTTP/1.1" status: 204  len: 168 time: 0.2782664
Jun 01 18:48:24.038953 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-92beef24-5eb1-4812-b7fa-9311ecfb288e service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3053977
Jun 01 18:48:24.092245 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-cc8822fb-5343-41d6-a4c1-18fc7f1d9383 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:24.093791 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-cc8822fb-5343-41d6-a4c1-18fc7f1d9383 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.1711559
Jun 01 18:48:24.236330 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d57f564a-15d4-425e-a326-0e64470e99d4 req-f4c2f62c-e467-4706-89f1-947a42d00c16 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1874168
Jun 01 18:48:24.281643 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-e3ead002-8213-4b1c-adf4-b01c7b71e333 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:24.284955 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-e3ead002-8213-4b1c-adf4-b01c7b71e333 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1827123
Jun 01 18:48:24.479280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af37b3bf-0c31-41ce-b181-a8adbb36b239 req-4b206dcd-b523-457d-a66e-72fff38e2cb1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:24.481072 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-af37b3bf-0c31-41ce-b181-a8adbb36b239 req-4b206dcd-b523-457d-a66e-72fff38e2cb1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1158097
Jun 01 18:48:24.487739 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-66fd0b39-5361-43e6-9e86-5b1a876b9e63 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1886201
Jun 01 18:48:24.537965 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-af37b3bf-0c31-41ce-b181-a8adbb36b239 req-03898c6a-206f-4aa5-824c-c6fda4e8db80 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489378
Jun 01 18:48:24.689604 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fe9091c1-34e1-4da1-8245-bbbd90023916 req-cf816e2b-d77c-473e-8f1e-714abebd5c96 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1945064
Jun 01 18:48:25.776308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2bbcbb-aec2-4260-b4a3-0250296d47a7 req-8dec7fd4-d0f3-46fd-a980-61710f0b73fa tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:25.777916 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b2bbcbb-aec2-4260-b4a3-0250296d47a7 req-8dec7fd4-d0f3-46fd-a980-61710f0b73fa tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1078475
Jun 01 18:48:25.837600 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b2bbcbb-aec2-4260-b4a3-0250296d47a7 req-77980ca5-052f-47f4-b438-d6b34f2ec9c9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0486391
Jun 01 18:48:26.028602 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e981c66-38e5-41b2-a260-360d7e8c8e44 req-032836aa-2f83-48c9-9906-450aa5d1f95f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:26.030701 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3e981c66-38e5-41b2-a260-360d7e8c8e44 req-032836aa-2f83-48c9-9906-450aa5d1f95f tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.1020420
Jun 01 18:48:26.086166 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3e981c66-38e5-41b2-a260-360d7e8c8e44 req-24bd90d1-f066-46c6-a39f-4c6af9451501 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446332
Jun 01 18:48:26.288847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33762) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:26.413977 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.427827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:26.431605 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Usage tracker for resource:security_group_rule and tenant:b021bea3949b4c4cbe59806880789b82 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:26.434405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:26.440123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:26.483500 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33768) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:26.530374 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.534462 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.543528 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8ea19bd0-de13-40f0-9293-9537d52d5bba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:26.583641 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=b021bea3949b4c4cbe59806880789b82&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2936702
Jun 01 18:48:26.584674 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76b48820-9ae4-4ec7-be2e-b51cc063c4d0,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:26.587480 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33772) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:26.587691 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:26.618749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.652106 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:26.660196 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Usage tracker for resource:security_group_rule and tenant:b98573720ec447188e5bfc37286c4c23 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:26.663856 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:26.676532 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:26.689404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.728822 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.825092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.825979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.831098 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:26.840634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.852801 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76b48820-9ae4-4ec7-be2e-b51cc063c4d0,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:26.857809 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:26.865624 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:26.885009 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:26.886126 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/76b48820-9ae4-4ec7-be2e-b51cc063c4d0 HTTP/1.1" status: 204  len: 168 time: 0.2972996
Jun 01 18:48:26.893275 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33780) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:26.900994 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=b98573720ec447188e5bfc37286c4c23&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4163051
Jun 01 18:48:26.920906 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6fa1c7d-fa24-4cd2-9dc8-d728d3a2cd0d,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:26.938136 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:27.022034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.055477 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.096274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89802afd-1417-4880-b5bf-064b1ced80f2 req-d56d4006-d4ab-4cee-bc88-1a6fbc2fcb33 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:27.099618 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-89802afd-1417-4880-b5bf-064b1ced80f2 req-d56d4006-d4ab-4cee-bc88-1a6fbc2fcb33 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1225741
Jun 01 18:48:27.138085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.143149 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ba3427e-40b3-433f-ae91-8c6c97ea5c93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:27.158230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6fa1c7d-fa24-4cd2-9dc8-d728d3a2cd0d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:27.163052 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:27.169929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.181668 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/d6fa1c7d-fa24-4cd2-9dc8-d728d3a2cd0d HTTP/1.1" status: 204  len: 168 time: 0.2796586
Jun 01 18:48:27.181927 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-89802afd-1417-4880-b5bf-064b1ced80f2 req-11338ac7-613a-4461-bf8a-c42f7db54cb6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0760427
Jun 01 18:48:27.439663 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2a2f95-556d-49d5-9d6a-e99435195c1a req-c2be0d8a-fee9-4ba2-9587-7ee31c3e4746 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:27.441320 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2d2a2f95-556d-49d5-9d6a-e99435195c1a req-c2be0d8a-fee9-4ba2-9587-7ee31c3e4746 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.1396909
Jun 01 18:48:27.502260 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2d2a2f95-556d-49d5-9d6a-e99435195c1a req-f3877c3a-b971-4159-a495-a1e44f983345 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0540011
Jun 01 18:48:27.739320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33818) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:27.757144 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.771977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:27.775776 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Usage tracker for resource:security_group_rule and tenant:04ef3e171d554a349cff94dfef5a4625 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:27.778705 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:27.784690 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:27.865151 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.873255 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:27.882341 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7d6efa97-003c-496b-b99a-548b1a0f2828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:27.925719 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=04ef3e171d554a349cff94dfef5a4625&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1853426
Jun 01 18:48:27.926635 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d86637f3-2476-47cb-b13e-d2b9836ce792,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:27.928493 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33824) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:27.929531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:27.981682 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33826) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:27.998824 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.025527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.084256 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.090358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:28.094969 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2140505485-network', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:28.099651 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:28.103722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d86637f3-2476-47cb-b13e-d2b9836ce792,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:28.104281 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Usage tracker for resource:network and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:28.106862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:28.107404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:28.108823 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.110060 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/d86637f3-2476-47cb-b13e-d2b9836ce792 HTTP/1.1" status: 204  len: 168 time: 0.1798980
Jun 01 18:48:28.118108 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:28.137811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Made reservation on behalf of 85f17a1d02ae4454a980be1331cbe34d for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:48:28.140296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.160729 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.175813 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:28.179610 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:28.182385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:28.188043 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:28.330458 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.347451 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.354832 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:28.387077 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] vlan segment allocate from pool success with {'vlan_id': 90, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:48:28.402909 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0151599b-d4dc-4caf-bec3-a0fa7ed5bbfc req-e2bc0289-b6f2-49e2-9731-cb32dd64092c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:28.404747 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0151599b-d4dc-4caf-bec3-a0fa7ed5bbfc req-e2bc0289-b6f2-49e2-9731-cb32dd64092c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1014962
Jun 01 18:48:28.410065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-81b590c8-55be-45cc-8fe5-5f16629db48d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:28.413675 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-81b590c8-55be-45cc-8fe5-5f16629db48d tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.25 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.1620686
Jun 01 18:48:28.417913 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.418462 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Added segment 78789faf-e362-4dcb-9299-2450da3fd2ca of type vlan for network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2
Jun 01 18:48:28.419541 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c3941d5-7f91-4f24-b26e-f38cb957a281,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:28.442760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:28.451280 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0151599b-d4dc-4caf-bec3-a0fa7ed5bbfc req-a42e2666-5945-4ade-8b80-21e34e810473 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408559
Jun 01 18:48:28.509722 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.600808 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.603472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:28.604044 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.611490 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:28.719960 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f01f9f-ac29-4b8b-b8e2-42c4d5e85a35 req-6be545e4-200b-4b48-866a-f0af393d71ce tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:28.727201 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f0f01f9f-ac29-4b8b-b8e2-42c4d5e85a35 req-6be545e4-200b-4b48-866a-f0af393d71ce tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 945 time: 0.1107631
Jun 01 18:48:28.748052 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Deleting port d39deb11-706c-4a8b-a636-d8d69ede4926 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:48:28.748699 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:28.781158 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f0f01f9f-ac29-4b8b-b8e2-42c4d5e85a35 req-31600167-8452-4c9d-8d17-66ea878d4253 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/security-groups?id=859fe75d-7de7-4022-9d0f-9b2a5874b27c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528617
Jun 01 18:48:28.802920 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.8174999
Jun 01 18:48:28.802920 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Pushing event updated for resources: {'Network': ['ID=4fe37e11-4ddd-41fd-b2d4-95525adc3be2,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:28.803562 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33864) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:28.809507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:28.811569 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Request body: {'subnet': {'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2140505485-subnet', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:28.816225 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:48:28.840802 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:28.845834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Usage tracker for resource:subnet and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:28.849745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:28.855827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:28.873722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Made reservation on behalf of 85f17a1d02ae4454a980be1331cbe34d for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:48:28.876825 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2101686'] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.028507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] For port d39deb11-706c-4a8b-a636-d8d69ede4926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=d39deb11-706c-4a8b-a636-d8d69ede4926,segment=NetworkSegment(ade580c3-c29b-43be-bce2-a56993c1cb04),segment_id=ade580c3-c29b-43be-bce2-a56993c1cb04)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:29.028507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.168922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Calling delete_port for d39deb11-706c-4a8b-a636-d8d69ede4926 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:48:29.357807 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.369747 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1394273', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2101636'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.371009 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['d39deb11-706c-4a8b-a636-d8d69ede4926'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:29.376978 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:29.385741 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-460c57b7-eba4-453b-a705-9d35f57346f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:29.494195 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Pushing event deleted for resources: {'Port': ['ID=d39deb11-706c-4a8b-a636-d8d69ede4926,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:29.497608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:29.585148 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4405465-78ee-42fa-bf1d-3f535d074d0b,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:29.591422 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:29.619347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] No DVR routers for this DVR port d39deb11-706c-4a8b-a636-d8d69ede4926 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:48:29.634353 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.645963 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Checking segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:29.646325 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Network hostable DHCP agents. Network: 4fe37e11-4ddd-41fd-b2d4-95525adc3be2, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:48:29.649071 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'name': 'network-vif-deleted', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:29.651692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6222963b-5388-4f94-b9ac-e147010c34d1" -d '{"events": [{"server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "name": "network-vif-deleted", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:29.684720 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b6010955-2d35-43fb-8263-d4fe4649fbc6 req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.25 "DELETE /v2.0/ports/d39deb11-706c-4a8b-a636-d8d69ede4926 HTTP/1.1" status: 204  len: 173 time: 1.2396176
Jun 01 18:48:29.796206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:48:29.821563 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 4fe37e11-4ddd-41fd-b2d4-95525adc3be2) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:29.833392 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc08c1d1-b23b-4c0c-893a-bec748895554 None None] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:48:29.833952 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:29.834342 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.861841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029cb3fd-1d9e-4d80-98bb-a944be0857d4 req-f42ab01e-2583-4cb2-a81d-72ebff363771 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:29.863349 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-029cb3fd-1d9e-4d80-98bb-a944be0857d4 req-f42ab01e-2583-4cb2-a81d-72ebff363771 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1903508
Jun 01 18:48:29.871160 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0647893
Jun 01 18:48:29.873804 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 33904) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:29.879469 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:29.884312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:29.897337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Usage tracker for resource:router and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:29.916682 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:29.921477 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-029cb3fd-1d9e-4d80-98bb-a944be0857d4 req-cbb426fd-c215-44c3-b946-2b39c4bf050e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489941
Jun 01 18:48:29.932132 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:29.941539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8725db13-2e7c-44f2-b3f0-e36c4173a296 x-openstack-request-id: req-8725db13-2e7c-44f2-b3f0-e36c4173a296 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:29.943502 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0601374a-4af2-445a-b892-f78d20cbcaa1", "name": "network-vif-deleted", "tag": "d39deb11-706c-4a8b-a636-d8d69ede4926", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:29.943908 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-8725db13-2e7c-44f2-b3f0-e36c4173a296 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:29.944661 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0601374a-4af2-445a-b892-f78d20cbcaa1', 'name': 'network-vif-deleted', 'tag': 'd39deb11-706c-4a8b-a636-d8d69ede4926', 'status': 'completed', 'code': 200}
Jun 01 18:48:29.946025 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.947404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:29.968472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.150769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-a926ff0c-1f9a-4c30-b89d-950b8db84832 req-83ebee83-44d4-4c5d-bc62-b2134123cb29 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Synchronizing usage tracker for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:48:30.168047 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:48:30.168945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.303246 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-a926ff0c-1f9a-4c30-b89d-950b8db84832 req-83ebee83-44d4-4c5d-bc62-b2134123cb29 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Unset dirty status for tenant:59a3ecd15231441e9ed00898e50aae60 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:48:30.304409 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a926ff0c-1f9a-4c30-b89d-950b8db84832 req-83ebee83-44d4-4c5d-bc62-b2134123cb29 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] 10.222.0.22 "GET /v2.0/ports?device_id=0601374a-4af2-445a-b892-f78d20cbcaa1 HTTP/1.1" status: 200  len: 210 time: 0.2543898
Jun 01 18:48:30.307092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.325547 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Allocated IP 172.20.0.2 (4fe37e11-4ddd-41fd-b2d4-95525adc3be2/e4405465-78ee-42fa-bf1d-3f535d074d0b/961b4c5c-4330-4095-9c49-9264a1ffe44e) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:30.545702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.560614 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Transition to ACTIVE for port object 961b4c5c-4330-4095-9c49-9264a1ffe44e will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:30.580495 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Transition to ACTIVE for port object 961b4c5c-4330-4095-9c49-9264a1ffe44e will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:30.586934 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.591487 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:30.621512 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.651273 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.653052 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:30.655876 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:30.662131 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:30.667704 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Pushing event updated for resources: {'Port': ['ID=961b4c5c-4330-4095-9c49-9264a1ffe44e,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:30.671774 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:30.758153 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Attempting to bind port 961b4c5c-4330-4095-9c49-9264a1ffe44e on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:30.758546 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Attempting to bind port 961b4c5c-4330-4095-9c49-9264a1ffe44e by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:30.758919 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Attempting to bind port 961b4c5c-4330-4095-9c49-9264a1ffe44e on network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:30.764250 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:30.764664 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Checking segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:30.765075 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.765476 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Bound using segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:30.765951 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Bound port: 961b4c5c-4330-4095-9c49-9264a1ffe44e, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:30.766334 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.794332 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Allocated IP 172.27.0.212 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/c501936f-0db2-4cfe-8c1d-43b10f874884) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:30.866985 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] For port 961b4c5c-4330-4095-9c49-9264a1ffe44e, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:30.872135 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] For port 961b4c5c-4330-4095-9c49-9264a1ffe44e, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=961b4c5c-4330-4095-9c49-9264a1ffe44e,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:30.877296 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:30.881641 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:30.977734 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Pushing event updated for resources: {'Port': ['ID=961b4c5c-4330-4095-9c49-9264a1ffe44e,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:30.986304 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:31.104703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:31.139987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:31.150411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:31.205460 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512ae6fe-6bb2-47d5-a67f-a2f0cf29b5d6 req-e601fae4-80fe-4373-b777-410a6cccfead tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:31.214041 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-512ae6fe-6bb2-47d5-a67f-a2f0cf29b5d6 req-e601fae4-80fe-4373-b777-410a6cccfead tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1231711
Jun 01 18:48:31.282757 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-512ae6fe-6bb2-47d5-a67f-a2f0cf29b5d6 req-6bd208e2-1472-4286-92d3-3ab89107a893 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0675974
Jun 01 18:48:31.330061 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:31.335382 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:31.339252 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:31.346488 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device d39deb11-706c-4a8b-a636-d8d69ede4926 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:48:31.391666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Pushing event updated for resources: {'Port': ['ID=c501936f-0db2-4cfe-8c1d-43b10f874884,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:31.398472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:31.433964 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: d39deb11-706c-4a8b-a636-d8d69ede4926 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:48:31.434651 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device d39deb11-706c-4a8b-a636-d8d69ede4926 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:48:31.917086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:31.982435 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 961b4c5c-4330-4095-9c49-9264a1ffe44e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:32.087364 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 961b4c5c-4330-4095-9c49-9264a1ffe44e completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:32.252912 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfd8f76f-af7b-482d-b004-53c213572add None None] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:48:32.290644 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:32.362650 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Provisioning for port 961b4c5c-4330-4095-9c49-9264a1ffe44e completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:32.379756 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Provisioning complete for port 961b4c5c-4330-4095-9c49-9264a1ffe44e triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:32.380130 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:32.495865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Router 950c7042-42b1-4123-9d8b-78b7f84afa7f is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:48:32.631124 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:32.678321 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] For port 961b4c5c-4330-4095-9c49-9264a1ffe44e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=961b4c5c-4330-4095-9c49-9264a1ffe44e,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:32.683241 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:32.687341 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:32.791122 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Pushing event updated for resources: {'Port': ['ID=961b4c5c-4330-4095-9c49-9264a1ffe44e,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:32.794186 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:32.829177 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:32.842022 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Sync routers for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:32.854043 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:32.854684 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf0c8b0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:32.869109 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:32.870578 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 2.9952021
Jun 01 18:48:32.873507 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 33976) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:33.033558 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-edffb73d-18e6-4a15-86b1-20d8bb2abc38 None None] Provisioning complete for port 961b4c5c-4330-4095-9c49-9264a1ffe44e triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:33.033987 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-edffb73d-18e6-4a15-86b1-20d8bb2abc38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.087397 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:33.422616 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf0c8b0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:31Z', 'revision_number': 3, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:33.426365 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Checking router: 950c7042-42b1-4123-9d8b-78b7f84afa7f for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:33.426721 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Updating router 950c7042-42b1-4123-9d8b-78b7f84afa7f port c501936f-0db2-4cfe-8c1d-43b10f874884 binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:48:33.477901 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.562749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.768492 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Allocated IP 172.20.0.1 (4fe37e11-4ddd-41fd-b2d4-95525adc3be2/e4405465-78ee-42fa-bf1d-3f535d074d0b/6c5819c9-ce8d-4a9f-af0d-238929d534aa) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:33.798938 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.810625 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Transition to ACTIVE for port object c501936f-0db2-4cfe-8c1d-43b10f874884 will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:33.817552 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.823088 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:33.914982 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Attempting to bind port c501936f-0db2-4cfe-8c1d-43b10f874884 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:33.915697 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Attempting to bind port c501936f-0db2-4cfe-8c1d-43b10f874884 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:33.915697 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Attempting to bind port c501936f-0db2-4cfe-8c1d-43b10f874884 on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:33.917659 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Pushing event updated for resources: {'Port': ['ID=c501936f-0db2-4cfe-8c1d-43b10f874884,revision_number=2']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:33.920834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.927872 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.928122 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 961b4c5c-4330-4095-9c49-9264a1ffe44e up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:33.928230 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.928557 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.928887 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.929210 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.929527 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.929846 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.930162 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.930495 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.930810 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.931120 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.931428 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:48:33.934635 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:33.935009 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:33.935412 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.935792 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:33.936264 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Bound port: c501936f-0db2-4cfe-8c1d-43b10f874884, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:33.936676 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.938542 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Transition to ACTIVE for port object 6c5819c9-ce8d-4a9f-af0d-238929d534aa will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:33.960204 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:33.963356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:33.968364 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:33.999862 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 961b4c5c-4330-4095-9c49-9264a1ffe44e triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:34.000371 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.015408 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] For port c501936f-0db2-4cfe-8c1d-43b10f874884, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:34.018979 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] For port c501936f-0db2-4cfe-8c1d-43b10f874884, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c501936f-0db2-4cfe-8c1d-43b10f874884,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:34.023297 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.027297 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a31838de-df93-4085-a95f-3070736ae6fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:34.036014 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:34.038942 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:34.041653 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:34.078763 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Pushing event updated for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:34.082899 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:34.107663 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.125526 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Pushing event updated for resources: {'Port': ['ID=c501936f-0db2-4cfe-8c1d-43b10f874884,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:34.129736 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-06f6edd0-f529-49d8-8b9b-c518c589cf58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:34.161789 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:34.164368 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf0c8b0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:34.323146 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5e791935-af79-4e85-98eb-ec553a458b30 None None] Provisioning for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:34.329381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5e791935-af79-4e85-98eb-ec553a458b30 None None] Provisioning complete for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:34.329898 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5e791935-af79-4e85-98eb-ec553a458b30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.384921 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:34.389586 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-5e791935-af79-4e85-98eb-ec553a458b30 None None] Port 6c5819c9-ce8d-4a9f-af0d-238929d534aa cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:48:34.405668 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.648814 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.658201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.718962 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fe21e83-8793-4cc9-ab63-6e75cf97123c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:34.741748 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf0c8b0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:33Z', 'revision_number': 1, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:34.747131 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11707910-5f1d-4d64-a4e8-0ac0343af33e None None] The sync data for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi is: [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:33Z', 'revision_number': 1, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:34.750910 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:34.829477 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Pushing event updated for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:34.832895 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:34.934112 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:34.935022 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:35.292943 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-a5815be0-e78d-4d02-bbb3-29ba1673145c service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2476654
Jun 01 18:48:35.302924 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Router 950c7042-42b1-4123-9d8b-78b7f84afa7f has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:48:35.335299 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-fc20d536-501f-40f5-8b0e-d993de0cfc4d None None] Provisioning complete for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:35.336340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-fc20d536-501f-40f5-8b0e-d993de0cfc4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:35.342999 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-c310a675-5449-4d4f-a8fd-05ae89701aac tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:35.350251 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-c310a675-5449-4d4f-a8fd-05ae89701aac tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.2122133
Jun 01 18:48:35.379040 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-dfc60e1b-b69e-4bc5-8ab7-4cad8bd1147c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/quotas/ab05a0b11f6c4dc5b84c7c8e30bafa9d HTTP/1.1" status: 200  len: 375 time: 0.0210774
Jun 01 18:48:35.422985 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df5a777-f285-4909-8ed4-182ed8a115bc req-1b3ba6f1-8b70-4ce5-8d6e-5ea68630eeb5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:35.425131 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0df5a777-f285-4909-8ed4-182ed8a115bc req-1b3ba6f1-8b70-4ce5-8d6e-5ea68630eeb5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.3062308
Jun 01 18:48:35.433974 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-fc20d536-501f-40f5-8b0e-d993de0cfc4d None None] Port 6c5819c9-ce8d-4a9f-af0d-238929d534aa cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:48:35.568650 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-968aea37-da8c-4da3-ab79-39d8b5f63f96 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1885548
Jun 01 18:48:35.570316 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-750c2240-f960-4c1c-a5aa-1e971da332ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:35.571600 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-750c2240-f960-4c1c-a5aa-1e971da332ba service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 1098 time: 0.1509647
Jun 01 18:48:35.576995 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0df5a777-f285-4909-8ed4-182ed8a115bc req-e753cc99-521e-4fe4-8102-ce80f6cc3b7f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1427283
Jun 01 18:48:35.614217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:35.627336 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] 10.222.0.22 "PUT /v2.0/routers/950c7042-42b1-4123-9d8b-78b7f84afa7f/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7520525
Jun 01 18:48:35.765666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34022) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:35.779488 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-25dd801c-1d62-4c3e-b19e-f6b07055a45d service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2040730
Jun 01 18:48:35.879389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Deleting subnet aa5c0080-0016-4f5c-9594-aea703cda2d9 {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:48:35.883653 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:35.979318 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.004989 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-ecdec0b0-95ee-4699-9a9d-5cad690b1294 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:36.006906 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-ecdec0b0-95ee-4699-9a9d-5cad690b1294 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 915 time: 0.4042411
Jun 01 18:48:36.088013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.114256 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-82f8331b-ebef-4654-bcd5-9aec36a5b2e0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7a59828a-57a1-4f2b-9392-36cb6d568256 HTTP/1.1" status: 200  len: 217 time: 0.0906644
Jun 01 18:48:36.118786 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c501936f-0db2-4cfe-8c1d-43b10f874884 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:36.247998 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-afc7dd02-f7b0-4585-bb1a-0cfacc6105ee service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4178042
Jun 01 18:48:36.292745 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-9c051810-5526-467c-957b-abbe4de9418e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:36.295122 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-9c051810-5526-467c-957b-abbe4de9418e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.1436067
Jun 01 18:48:36.341533 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port c501936f-0db2-4cfe-8c1d-43b10f874884 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:36.353529 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port c501936f-0db2-4cfe-8c1d-43b10f874884 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:36.354132 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.475240 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-12d50ed4-b729-4e47-9250-be7a14630b56 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1655462
Jun 01 18:48:36.681852 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d6416d12-4f2a-4b3e-b657-30dc230be9f8 req-924f2bb1-08d7-4dc0-a848-d51b0a0ad0b4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 210 time: 0.1241062
Jun 01 18:48:36.739818 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.771176 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port c501936f-0db2-4cfe-8c1d-43b10f874884, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c501936f-0db2-4cfe-8c1d-43b10f874884,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:36.777573 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.779872 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:36.812358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.818568 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ac02bfba-8458-423b-9734-bd1e0637ebc8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:36.864747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=c501936f-0db2-4cfe-8c1d-43b10f874884,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:36.867528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:36.916039 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa5c0080-0016-4f5c-9594-aea703cda2d9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:36.927710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:36.929709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:36.933103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34058) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:36.938909 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2000933790-network', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:36.947642 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:36.952293 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-892b3fa1-35f4-47cc-af5b-2385d5bce65e admin admin] 10.222.0.22 "DELETE /v2.0/subnets/aa5c0080-0016-4f5c-9594-aea703cda2d9 HTTP/1.1" status: 204  len: 168 time: 1.1856041
Jun 01 18:48:36.953708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Usage tracker for resource:network and tenant:0b98a000057541b9ab9d7a211142b5ee is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:36.956471 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34062) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:36.975935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:36.996801 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:37.025003 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b943714a-3654-49c9-a94c-13aac3af2fbc req-f2c6d28f-7c75-4b67-9717-202be01d158c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:37.032499 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b943714a-3654-49c9-a94c-13aac3af2fbc req-f2c6d28f-7c75-4b67-9717-202be01d158c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1243131
Jun 01 18:48:37.092278 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b943714a-3654-49c9-a94c-13aac3af2fbc req-8dcb5c7b-b9ac-4298-a80d-86e85002e0e0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585053
Jun 01 18:48:37.215703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Made reservation on behalf of 0b98a000057541b9ab9d7a211142b5ee for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:48:37.218029 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.235006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.237780 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.261816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:37.267287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Usage tracker for resource:security_group_rule and tenant:0b98a000057541b9ab9d7a211142b5ee is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:37.297537 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:37.319666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:37.406752 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.424172 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd923970>,) {'filters': {'network_id': ['d7df87fc-8cf1-444a-903c-77524e3d6866']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:37.439635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd923970>, 'ade580c3-c29b-43be-bce2-a56993c1cb04') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:37.439942 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd923970>, 'ade580c3-c29b-43be-bce2-a56993c1cb04') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:37.455933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.479228 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.490179 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Releasing vlan 52 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:48:37.490554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:48:37.503230 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:48:37.553104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Sync routers for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:37.562417 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:37.563038 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9523d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:37.599443 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.600847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.602731 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.607110 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:37.622544 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.639348 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] vlan segment allocate from pool success with {'vlan_id': 97, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:48:37.656183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd3e2e82-d2e0-4913-b8c4-e1f4a174b70c,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:37.658916 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.659253 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Added segment 761db241-fddf-4c50-be1c-a1d82b6e4d30 of type vlan for network eb77fbe1-d543-4027-9623-8adf5aa5e9aa
Jun 01 18:48:37.665957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:37.666441 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-88423dd2-b20c-4804-96a6-87591748b29e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:37.689099 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] 10.222.0.22 "DELETE /v2.0/networks/d7df87fc-8cf1-444a-903c-77524e3d6866 HTTP/1.1" status: 204  len: 168 time: 0.7286091
Jun 01 18:48:37.691002 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Pushing event deleted for resources: {'Network': ['ID=d7df87fc-8cf1-444a-903c-77524e3d6866,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:37.694638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:37.716847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.748318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:37.749983 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.751425 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:37.752062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.755717 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ec5007-6208-4d8e-968e-33bf2c888967 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:37.855893 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.9189117
Jun 01 18:48:37.856201 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34080) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:37.859058 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Pushing event updated for resources: {'Network': ['ID=eb77fbe1-d543-4027-9623-8adf5aa5e9aa,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:37.861798 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:37.863152 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Request body: {'subnet': {'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2000933790-subnet', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:37.868154 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:37.873494 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Usage tracker for resource:subnet and tenant:0b98a000057541b9ab9d7a211142b5ee is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:37.877253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:37.884326 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:37.898673 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Made reservation on behalf of 0b98a000057541b9ab9d7a211142b5ee for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:48:37.902604 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3724192'] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:37.903100 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:48:37.911530 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34082) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:37.966320 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e653f765-8e17-457d-b35c-290c5408336b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=59a3ecd15231441e9ed00898e50aae60&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0533795
Jun 01 18:48:37.968753 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34084) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:38.007162 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c501936f-0db2-4cfe-8c1d-43b10f874884 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:38.031801 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.060929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.119331 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.125948 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1a81a31f-461b-4d0e-8fc5-a0c3e3f3fefb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:38.140063 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=859fe75d-7de7-4022-9d0f-9b2a5874b27c,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:38.142691 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:38.154522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.158332 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/859fe75d-7de7-4022-9d0f-9b2a5874b27c HTTP/1.1" status: 204  len: 168 time: 0.1861019
Jun 01 18:48:38.215941 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port c501936f-0db2-4cfe-8c1d-43b10f874884 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:38.216314 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.301342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9523d0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 2, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:38.307199 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Checking router: 950c7042-42b1-4123-9d8b-78b7f84afa7f for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:38.307765 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Updating router 950c7042-42b1-4123-9d8b-78b7f84afa7f port 6c5819c9-ce8d-4a9f-af0d-238929d534aa binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:48:38.410754 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.449165 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2209766', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3724178'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.458591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:38.530453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0686cff7-f6f6-4087-8dd6-308dec1639ca,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:38.533908 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:38.539804 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Checking segment: {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:38.540285 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Network hostable DHCP agents. Network: eb77fbe1-d543-4027-9623-8adf5aa5e9aa, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:48:38.559796 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:48:38.574309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, eb77fbe1-d543-4027-9623-8adf5aa5e9aa) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:38.584312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:38.585279 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.588498 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-274838c5-f652-40c9-9344-124d94089e32 None None] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:48:38.623550 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7655895
Jun 01 18:48:38.624414 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34102) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:38.631189 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:38.637853 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:38.642759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Usage tracker for resource:router and tenant:0b98a000057541b9ab9d7a211142b5ee is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:38.645926 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:38.652900 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:38.657183 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84600c90-429e-4bca-997a-7834c12a8581 req-a891ce7f-399e-493a-a6fb-e80bd2a503c3 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 210 time: 0.0669179
Jun 01 18:48:38.670422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.672117 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.695028 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.884544 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffecb146-e5b7-48c3-8449-3cb71143ab2e req-37821b71-1274-4807-a119-5b65e49e9278 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:38.894157 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ffecb146-e5b7-48c3-8449-3cb71143ab2e req-37821b71-1274-4807-a119-5b65e49e9278 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1197286
Jun 01 18:48:38.942273 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'fixed_ips': [{'subnet_id': '0686cff7-f6f6-4087-8dd6-308dec1639ca'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:48:38.943679 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:38.962902 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ffecb146-e5b7-48c3-8449-3cb71143ab2e req-3b0e1b88-0c90-4edd-8de8-3485f8506d3d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0677056
Jun 01 18:48:39.036514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.077646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.089644 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.116158 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Transition to ACTIVE for port object 6c5819c9-ce8d-4a9f-af0d-238929d534aa will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:39.127373 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.157465 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:39.332994 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Pushing event updated for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:39.341772 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:39.370057 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Allocated IP 172.20.0.2 (eb77fbe1-d543-4027-9623-8adf5aa5e9aa/0686cff7-f6f6-4087-8dd6-308dec1639ca/5f320236-6957-4373-8e3c-9a9582bf0c23) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:39.387543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.417972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Attempting to bind port 6c5819c9-ce8d-4a9f-af0d-238929d534aa on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:39.418349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Attempting to bind port 6c5819c9-ce8d-4a9f-af0d-238929d534aa by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:39.418713 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Attempting to bind port 6c5819c9-ce8d-4a9f-af0d-238929d534aa on network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:39.441002 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:39.441908 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Checking segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:39.442317 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.442708 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Bound using segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:39.443196 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Bound port: 6c5819c9-ce8d-4a9f-af0d-238929d534aa, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:39.443836 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.445046 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.633424 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] For port 6c5819c9-ce8d-4a9f-af0d-238929d534aa, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:39.678808 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Allocated IP 172.27.0.252 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/e3321a7a-4a12-4fa7-9146-6295949c61eb) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:39.732191 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] For port 6c5819c9-ce8d-4a9f-af0d-238929d534aa, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=6c5819c9-ce8d-4a9f-af0d-238929d534aa,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:39.738583 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.754702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.761423 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-099860d7-ce09-40ef-8088-78b75a6cf809 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:39.802439 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Transition to ACTIVE for port object 5f320236-6957-4373-8e3c-9a9582bf0c23 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:39.849475 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Transition to ACTIVE for port object 5f320236-6957-4373-8e3c-9a9582bf0c23 will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:39.868105 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:39.901413 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Pushing event updated for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:39.906851 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:39.907481 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9523d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:39.947338 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b93a4471-cab1-455b-8547-bba7f17615a2 req-9f4c87fc-0716-4bac-abc5-a855e295cde6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 210 time: 0.0848398
Jun 01 18:48:40.054265 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:40.054707 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.168s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:40.056188 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:40.090231 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-80dbd9fd-2e71-4cde-8a6b-6fdf54735777 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4787924
Jun 01 18:48:40.110179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:40.126043 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:40.136111 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:40.153135 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:40.159647 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:40.350728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Pushing event updated for resources: {'Port': ['ID=5f320236-6957-4373-8e3c-9a9582bf0c23,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:40.367491 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:40.383351 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Attempting to bind port 5f320236-6957-4373-8e3c-9a9582bf0c23 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:40.383761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Attempting to bind port 5f320236-6957-4373-8e3c-9a9582bf0c23 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:40.384134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Attempting to bind port 5f320236-6957-4373-8e3c-9a9582bf0c23 on network eb77fbe1-d543-4027-9623-8adf5aa5e9aa {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:40.394629 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:40.395007 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Checking segment: {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:40.395410 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:40.395807 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Bound using segment: {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:40.396291 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Bound port: 5f320236-6957-4373-8e3c-9a9582bf0c23, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:40.396965 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:40.410977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:40.417591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:40.420418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:40.423205 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:40.488019 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Pushing event updated for resources: {'Port': ['ID=e3321a7a-4a12-4fa7-9146-6295949c61eb,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:40.512258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:40.529925 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dec0d287-1abc-4096-b119-cb0cc6af50d2 req-a73086fa-b55a-40f3-b036-fe1f4727c2d6 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4128973
Jun 01 18:48:40.674407 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] For port 5f320236-6957-4373-8e3c-9a9582bf0c23, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:40.730122 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] For port 5f320236-6957-4373-8e3c-9a9582bf0c23, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=5f320236-6957-4373-8e3c-9a9582bf0c23,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:40.743850 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:40.751173 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-5da431e3-28c8-45c8-841c-e2a7a44a21ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:40.827925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f785b6a-841f-4e4f-aa3c-b79b20d24f04 req-dc700a48-c094-4a2f-8f67-046a8aaa728b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:40.837361 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3f785b6a-841f-4e4f-aa3c-b79b20d24f04 req-dc700a48-c094-4a2f-8f67-046a8aaa728b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.6493022
Jun 01 18:48:40.909830 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Pushing event updated for resources: {'Port': ['ID=5f320236-6957-4373-8e3c-9a9582bf0c23,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:40.913803 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:40.959407 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3f785b6a-841f-4e4f-aa3c-b79b20d24f04 req-13eb62de-0a25-45b8-a0b9-796038e8f628 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1210341
Jun 01 18:48:40.961729 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9523d0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:39Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:40.967031 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1868f174-cff2-4c02-8b7a-c52319acef88 None None] The sync data for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi is: [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:39Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:41.282127 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c1136fce-c22b-455d-aa59-4743adc3f72d req-e6993f45-5754-4de1-89fa-e1a66cd48fdd tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 210 time: 0.0949600
Jun 01 18:48:41.418904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-6a3de4d9-1b9e-45f1-88cc-16fe01abfa62 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:41.420370 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-6a3de4d9-1b9e-45f1-88cc-16fe01abfa62 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.7666121
Jun 01 18:48:41.445332 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Request body: {'port': {'device_id': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'admin_state_up': True, 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:41.641600 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:41.742650 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:41.752249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:41.768237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:48:41.769998 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.139179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 6c5819c9-ce8d-4a9f-af0d-238929d534aa up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:42.193757 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-195894df-05e5-4a8a-8514-9d83a0946813 req-7ed3eb4e-b435-45eb-8b4f-7401672f6213 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:42.203221 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-195894df-05e5-4a8a-8514-9d83a0946813 req-7ed3eb4e-b435-45eb-8b4f-7401672f6213 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1050124
Jun 01 18:48:42.237388 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:42.251871 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:42.252465 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.294585 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-195894df-05e5-4a8a-8514-9d83a0946813 req-c7a3a623-6ebe-4d05-9b24-b18b4a4f2315 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0903947
Jun 01 18:48:42.374112 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2342d710-a14b-4d7b-bd8a-f0cd31017994 None None] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:48:42.444554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.492031 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.530789 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-4443937f-19f7-4cd5-b9ea-95c4ad10b030 None None] Provisioning for port 5f320236-6957-4373-8e3c-9a9582bf0c23 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:42.550936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Allocated IP 172.20.0.3 (2bc7607a-0e83-4423-b9b7-ac3e13607a13/b40008fb-ef5f-4ddd-be90-93c9dd2d5423/00a066ed-ad86-4d31-9083-bf2f681a2c2c) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:42.586810 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 6c5819c9-ce8d-4a9f-af0d-238929d534aa, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=6c5819c9-ce8d-4a9f-af0d-238929d534aa,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:42.592954 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.593695 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 5f320236-6957-4373-8e3c-9a9582bf0c23 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:42.624301 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:42.766438 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:42.772103 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:42.784502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 5f320236-6957-4373-8e3c-9a9582bf0c23 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:42.792737 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 5f320236-6957-4373-8e3c-9a9582bf0c23 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:42.793130 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.817198 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:48:42.921115 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.948711 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.953943 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 5f320236-6957-4373-8e3c-9a9582bf0c23, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=5f320236-6957-4373-8e3c-9a9582bf0c23,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:42.959018 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:42.961464 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:43.036023 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=5f320236-6957-4373-8e3c-9a9582bf0c23,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:43.039682 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:43.051378 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:43.061187 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Sync routers for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:43.074079 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:43.074910 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cda78610>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:43.079261 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.086703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:43.091493 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-af047313-3f06-42a2-b042-a3bfcab8e505 None None] Provisioning complete for port 5f320236-6957-4373-8e3c-9a9582bf0c23 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:43.092056 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-af047313-3f06-42a2-b042-a3bfcab8e505 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.141084 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.144474 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 4.5166159
Jun 01 18:48:43.145522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34196) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:43.164668 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:43.167861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:43.172416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:43.200283 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event updated for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:43.207355 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:43.241744 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:43.242352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.263823 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.8254919
Jun 01 18:48:43.339129 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:43.623101 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cda78610>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:41Z', 'revision_number': 3, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:43.626814 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Checking router: 84fe2f5a-8613-4292-8a5b-f08a64655ee3 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:43.627164 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Updating router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 port e3321a7a-4a12-4fa7-9146-6295949c61eb binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:48:43.680315 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.888387 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:43.943316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 6c5819c9-ce8d-4a9f-af0d-238929d534aa up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:44.002900 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.016019 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Transition to ACTIVE for port object e3321a7a-4a12-4fa7-9146-6295949c61eb will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:44.023297 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.030230 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-df2d3a09-579f-4144-8de7-2e1a9ff6944b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:44.054764 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 6c5819c9-ce8d-4a9f-af0d-238929d534aa triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:44.055073 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.106588 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a596aeb-6a87-4069-9d59-900e79cd778d None None] Pushing event updated for resources: {'Port': ['ID=e3321a7a-4a12-4fa7-9146-6295949c61eb,revision_number=2']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:44.109986 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-8a596aeb-6a87-4069-9d59-900e79cd778d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:44.110962 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Attempting to bind port e3321a7a-4a12-4fa7-9146-6295949c61eb on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:44.111187 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Attempting to bind port e3321a7a-4a12-4fa7-9146-6295949c61eb by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:44.111740 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Attempting to bind port e3321a7a-4a12-4fa7-9146-6295949c61eb on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:44.120390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Allocated IP 172.20.0.1 (eb77fbe1-d543-4027-9623-8adf5aa5e9aa/0686cff7-f6f6-4087-8dd6-308dec1639ca/82e5e970-63b6-46d7-93d8-ac0c6157f271) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:48:44.138150 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:44.138883 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:44.139665 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.140765 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:44.141546 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Bound port: e3321a7a-4a12-4fa7-9146-6295949c61eb, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:44.142397 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.196037 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-754fcecc-e715-44e9-85f0-3a0ddd039953 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.204661 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 5f320236-6957-4373-8e3c-9a9582bf0c23 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:44.250048 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] For port e3321a7a-4a12-4fa7-9146-6295949c61eb, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:44.254424 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] For port e3321a7a-4a12-4fa7-9146-6295949c61eb, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e3321a7a-4a12-4fa7-9146-6295949c61eb,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:44.258413 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.264216 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a943cf65-1fd4-42c5-bb03-15f3676c39f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:44.270646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 5f320236-6957-4373-8e3c-9a9582bf0c23 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:44.271032 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.281730 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.297214 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Transition to ACTIVE for port object 82e5e970-63b6-46d7-93d8-ac0c6157f271 will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:44.323234 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.329232 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:44.337898 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:44.338631 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cda78610>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:44.390894 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:44.396086 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:44.400620 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:48:44.408770 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a596aeb-6a87-4069-9d59-900e79cd778d None None] Pushing event updated for resources: {'Port': ['ID=e3321a7a-4a12-4fa7-9146-6295949c61eb,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:44.413533 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-8a596aeb-6a87-4069-9d59-900e79cd778d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:44.439141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Pushing event updated for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:44.444007 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:44.463496 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.537485 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:44.608155 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.653362 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2e35b335-fe12-4659-b120-61f8898bf51c None None] Provisioning for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:44.660838 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2e35b335-fe12-4659-b120-61f8898bf51c None None] Provisioning complete for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:44.661480 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-2e35b335-fe12-4659-b120-61f8898bf51c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.718588 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-2e35b335-fe12-4659-b120-61f8898bf51c None None] Port 82e5e970-63b6-46d7-93d8-ac0c6157f271 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:48:44.834362 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.839295 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.867535 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:44.874525 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cda78610>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:41Z', 'revision_number': 3, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:44.878381 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d37bc9a-a194-46ba-ac4d-25a47087b300 None None] The sync data for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi is: [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:41Z', 'revision_number': 3, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:44.947376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:44.957870 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Pushing event updated for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:44.962290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:44.967166 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:44.970166 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Request body: {'port': {'device_id': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:45.156888 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:48:45.158344 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:48:45.179134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:45.456099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-57feaaae-49bf-4126-b078-ca9153342a6f None None] Provisioning complete for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:45.456667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-57feaaae-49bf-4126-b078-ca9153342a6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:45.468672 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885dc5df-a0e4-4da0-9bf5-e3472fd65ff2 req-f9210aa5-0d00-4a1c-b88c-ae238038fc51 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:45.469537 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-885dc5df-a0e4-4da0-9bf5-e3472fd65ff2 req-f9210aa5-0d00-4a1c-b88c-ae238038fc51 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:48:45.531169 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-885dc5df-a0e4-4da0-9bf5-e3472fd65ff2 req-f9210aa5-0d00-4a1c-b88c-ae238038fc51 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:48:45.532192 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-57feaaae-49bf-4126-b078-ca9153342a6f None None] Port 82e5e970-63b6-46d7-93d8-ac0c6157f271 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:48:45.532981 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-885dc5df-a0e4-4da0-9bf5-e3472fd65ff2 req-f9210aa5-0d00-4a1c-b88c-ae238038fc51 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 931 time: 0.3389592
Jun 01 18:48:45.634554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73254ec0-96e4-4e0c-ac87-40f2fb565745 req-28a6bec2-5a77-4ffa-9dd9-3d24f893cd8c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:45.642132 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73254ec0-96e4-4e0c-ac87-40f2fb565745 req-28a6bec2-5a77-4ffa-9dd9-3d24f893cd8c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.3280795
Jun 01 18:48:45.666286 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-885dc5df-a0e4-4da0-9bf5-e3472fd65ff2 req-9012b455-40a7-455e-bb0b-7cc1ca4742b9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1250644
Jun 01 18:48:45.734585 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73254ec0-96e4-4e0c-ac87-40f2fb565745 req-f34eb01d-5cae-451f-ab34-347702fc798c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0918226
Jun 01 18:48:45.756217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:48:45.805700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 00a066ed-ad86-4d31-9083-bf2f681a2c2c {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:45.819191 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:45.838527 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Transition to ACTIVE for port object 00a066ed-ad86-4d31-9083-bf2f681a2c2c will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:45.845354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:45.855922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0a95318c-f649-46d6-9589-f1149a662c7e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:46.031239 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e3321a7a-4a12-4fa7-9146-6295949c61eb up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:46.139279 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port e3321a7a-4a12-4fa7-9146-6295949c61eb completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:46.148408 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port e3321a7a-4a12-4fa7-9146-6295949c61eb triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:46.149409 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.209749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:48:46.232474 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] 10.222.0.22 "PUT /v2.0/routers/84fe2f5a-8613-4292-8a5b-f08a64655ee3/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0850809
Jun 01 18:48:46.357534 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.389115 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port e3321a7a-4a12-4fa7-9146-6295949c61eb, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e3321a7a-4a12-4fa7-9146-6295949c61eb,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:46.394654 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.399751 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-3b717575-c506-4cd3-80c1-89489b2639b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:46.413433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Attempting to bind port 00a066ed-ad86-4d31-9083-bf2f681a2c2c on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:46.413961 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Attempting to bind port 00a066ed-ad86-4d31-9083-bf2f681a2c2c by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:46.414071 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Attempting to bind port 00a066ed-ad86-4d31-9083-bf2f681a2c2c on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:46.420889 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Port 00a066ed-ad86-4d31-9083-bf2f681a2c2c on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:48:46.421404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Attempting to bind port 00a066ed-ad86-4d31-9083-bf2f681a2c2c on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:46.429662 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Pushing event updated for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:46.434220 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:46.434745 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Checking segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:46.435273 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Bound using segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:46.435860 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Bound port: 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:46.436369 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.454411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.598s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:46.494903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=e3321a7a-4a12-4fa7-9146-6295949c61eb,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:46.499873 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:46.541337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:46.545288 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:46.570095 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.579156 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:46.664122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Pushing event updated for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:46.668017 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:46.669438 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:46.670365 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.672444 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] 10.222.0.25 "PUT /v2.0/ports/00a066ed-ad86-4d31-9083-bf2f681a2c2c HTTP/1.1" status: 200  len: 1093 time: 1.7070034
Jun 01 18:48:46.673041 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:46.675453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9231052-2fb0-4766-afd3-9bca0ff86d1a" -d '{"events": [{"name": "network-changed", "server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:46.703145 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-233b26ce-8cee-4dcf-9eaf-1cb2db99fece None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.831628 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-0866d51f-c3c3-4eba-bf21-f768ad068e86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:46.850705 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-0866d51f-c3c3-4eba-bf21-f768ad068e86 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 1096 time: 0.1268351
Jun 01 18:48:46.877855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:46.969745 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65965b7a-5590-45a9-a606-afbff45888ca x-openstack-request-id: req-65965b7a-5590-45a9-a606-afbff45888ca {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:46.970058 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:46.970332 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-65965b7a-5590-45a9-a606-afbff45888ca {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:46.970753 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c', 'status': 'completed', 'code': 200}
Jun 01 18:48:46.987564 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-1a3dcbad-9785-4ddb-8749-90a257609516 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c HTTP/1.1" status: 200  len: 217 time: 0.1234388
Jun 01 18:48:47.103896 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411571ac-eaa2-4625-99ac-ef4935471239 req-9ea354e5-e5c7-4740-984c-56740eb7a4ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:47.109957 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-9ea354e5-e5c7-4740-984c-56740eb7a4ea service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.1135173
Jun 01 18:48:47.151537 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0edfac12-2a6f-477f-8963-3c38a3305ae3 req-e9a9b223-cd0d-4801-8e48-8eeb3cc05023 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:47.158476 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0edfac12-2a6f-477f-8963-3c38a3305ae3 req-e9a9b223-cd0d-4801-8e48-8eeb3cc05023 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 943 time: 0.1002624
Jun 01 18:48:47.183694 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34298) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:47.188215 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Sync routers for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:48:47.206206 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1231457379', 'description': 'tempest-secgroup-smoke-1231457379 description', 'project_id': '85f17a1d02ae4454a980be1331cbe34d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:47.207744 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:47.209787 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdca6550>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:47.230176 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0edfac12-2a6f-477f-8963-3c38a3305ae3 req-a150da9a-d78a-4bff-a6d1-10f18ec98a3b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0705073
Jun 01 18:48:47.250756 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-a52e1210-9cca-4a2c-a8d5-f29ed902cd64 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1302686
Jun 01 18:48:47.252139 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:47.332870 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:47.342439 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:47.405769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:47.496547 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:47.530845 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:47.552078 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:47.561276 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-6c75c240-1d70-497b-a071-f768447a6642 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2854221
Jun 01 18:48:47.562149 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:47.565847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:47.598878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:47.621738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ccfaa7-d5ca-4edf-abb7-f9a9cf59e1d3 req-cb53fceb-6425-491c-b81e-876cfc90b4ae tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:47.623178 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31ccfaa7-d5ca-4edf-abb7-f9a9cf59e1d3 req-cb53fceb-6425-491c-b81e-876cfc90b4ae tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.2818854
Jun 01 18:48:47.777398 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31ccfaa7-d5ca-4edf-abb7-f9a9cf59e1d3 req-b7feb69a-0eb8-40cb-8547-62bc1e3917fd tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1404626
Jun 01 18:48:47.792881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:47.809252 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-411571ac-eaa2-4625-99ac-ef4935471239 req-556d2fe2-59ca-4db0-8cd1-a7af8a2ce75c service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2378335
Jun 01 18:48:47.855078 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:47.863481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:47.871551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:47.901195 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdca6550>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 4, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '82e5e970-63b6-46d7-93d8-ac0c6157f271', 'name': '', 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'mac_address': 'fa:16:3e:f9:cc:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_interface', 'standard_attr_id': 247, 'fixed_ips': [{'subnet_id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:43Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 2, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'subnets': [{'id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:47.906167 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Checking router: 84fe2f5a-8613-4292-8a5b-f08a64655ee3 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:48:47.906526 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Updating router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 port 82e5e970-63b6-46d7-93d8-ac0c6157f271 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:48:47.949435 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e3321a7a-4a12-4fa7-9146-6295949c61eb up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:47.973850 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:47.975098 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.7801793
Jun 01 18:48:47.977848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d9074e75-527a-4712-b152-f716718c4332,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:47.978516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34322) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:47.981355 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:47.985543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:47.994473 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:47.999931 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:48.001471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-34dc1279-25f2-4cdc-87c9-2a4146c1d94d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:48.003640 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-34dc1279-25f2-4cdc-87c9-2a4146c1d94d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 1096 time: 0.1212995
Jun 01 18:48:48.004049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:48.011691 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:48.013911 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.033110 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.113818 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.119241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.122715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-71678ab8-cb79-4447-8aef-efb82a8c9f6b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:48.152135 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1477bbf1-a973-4ebf-83a9-be68d2c6058f,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:48.161620 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:48.168270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.170137 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ece3130b-2215-41f9-a8e6-8dbcb2f18c8a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1895647
Jun 01 18:48:48.172709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34328) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:48.177785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-9bb2f10e-f52f-4716-94e3-619b1dae43e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:48.180053 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-9bb2f10e-f52f-4716-94e3-619b1dae43e4 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 915 time: 0.1680262
Jun 01 18:48:48.180394 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:48.188776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:48.193416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:48.196739 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:48.203349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:48.203525 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port e3321a7a-4a12-4fa7-9146-6295949c61eb triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:48.203983 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.229793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.298878 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-a1069b6f-ad03-494f-84d6-710e5de44799 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c HTTP/1.1" status: 200  len: 217 time: 0.1102901
Jun 01 18:48:48.325803 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.334073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.345640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:48.375531 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81014cf1-5a75-4065-9469-decf19251b6e,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:48.384241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:48.387828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.389518 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2156847
Jun 01 18:48:48.392717 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34344) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:48.399978 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:48.407679 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:48.413662 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:48.416993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:48.426478 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:48.470950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-b256542a-1dd5-4435-ac4b-ce79b9354900 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:48.475084 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-b256542a-1dd5-4435-ac4b-ce79b9354900 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.1677692
Jun 01 18:48:48.563640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.579699 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.587273 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-35374da5-e938-4fb7-ba8f-98ef4b77f55f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1053164
Jun 01 18:48:48.611439 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Transition to ACTIVE for port object 82e5e970-63b6-46d7-93d8-ac0c6157f271 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:48:48.631011 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.637922 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:48.760994 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.798249 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39f6248-f2dd-4bc0-95f0-557f0ac45baa req-6b8ab6d8-3ff6-4863-a1cd-8eae831d92b2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:48.799792 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Pushing event updated for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:48.809407 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d39f6248-f2dd-4bc0-95f0-557f0ac45baa req-6b8ab6d8-3ff6-4863-a1cd-8eae831d92b2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 943 time: 0.3698366
Jun 01 18:48:48.847778 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:48.884271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34360) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:48.886739 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:48.928222 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:48.963764 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d39f6248-f2dd-4bc0-95f0-557f0ac45baa req-329e10b7-5e35-4b0f-b189-250a00081ef0 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1520460
Jun 01 18:48:48.979999 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fe69cf67-246e-4e03-b552-8678c1776911,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:48.993893 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:48.998857 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-50bc2862-747f-43d2-b243-922902b9fb15 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4034600
Jun 01 18:48:49.000871 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.005436 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34364) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:49.005671 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-09c7bdc4-d8f8-4bbf-bfd2-0387c04e5007 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6114366
Jun 01 18:48:49.010460 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:49.062435 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:49.098391 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:49.116049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:49.154467 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:49.155819 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Attempting to bind port 82e5e970-63b6-46d7-93d8-ac0c6157f271 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:48:49.156198 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Attempting to bind port 82e5e970-63b6-46d7-93d8-ac0c6157f271 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:48:49.156669 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Attempting to bind port 82e5e970-63b6-46d7-93d8-ac0c6157f271 on network eb77fbe1-d543-4027-9623-8adf5aa5e9aa {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:48:49.164265 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:48:49.164734 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Checking segment: {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:48:49.165145 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.165541 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Bound using segment: {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:48:49.166016 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Bound port: 82e5e970-63b6-46d7-93d8-ac0c6157f271, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '761db241-fddf-4c50-be1c-a1d82b6e4d30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 97, 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:48:49.166393 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.244964 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434d58d8-b94a-4476-98fb-c7a3083c807f req-75b953a9-84b2-49c2-9bfd-4360599005b4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:49.247436 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-434d58d8-b94a-4476-98fb-c7a3083c807f req-75b953a9-84b2-49c2-9bfd-4360599005b4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0967362
Jun 01 18:48:49.305166 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] For port 82e5e970-63b6-46d7-93d8-ac0c6157f271, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:48:49.310342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] For port 82e5e970-63b6-46d7-93d8-ac0c6157f271, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=82e5e970-63b6-46d7-93d8-ac0c6157f271,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:48:49.313692 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-434d58d8-b94a-4476-98fb-c7a3083c807f req-1da161bc-bf69-4427-b94b-71d6ba47d957 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602732
Jun 01 18:48:49.315863 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.320931 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:49.353283 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.390371 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:49.395651 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.409446 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:48:49.410129 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdca6550>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:48:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:49.411009 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Usage tracker for resource:security_group_rule and tenant:5d7b6c6534b84607a19e1949f736b3e8 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:49.417026 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:49.444579 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:49.466952 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9231052-2fb0-4766-afd3-9bca0ff86d1a req-bb280a43-ae65-4ccb-958a-4f3a165e6f44 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4349823
Jun 01 18:48:49.489532 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Pushing event updated for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:49.504349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:49.516868 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.529890 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.536042 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.543542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:49.567657 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ea9501f-a34f-4669-b367-139499ea45d1,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:49.576293 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:49.610136 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.611389 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.6044891
Jun 01 18:48:49.615231 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34386) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:49.622310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:49.636481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.637159 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:49.643271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.649648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:49.652667 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:49.659639 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:48:49.675255 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:49.679430 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-32e14dcd-3005-4dc0-a459-d60f339b4a10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:49.690444 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.securitygroups_db [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Project 85f17a1d02ae4454a980be1331cbe34d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:48:49.702681 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.715463 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=5d7b6c6534b84607a19e1949f736b3e8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8236346
Jun 01 18:48:49.715463 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f8805b0-68bc-4f34-a2e3-e6571742af3a,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:49.716354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34392) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:49.790710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:49.822608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.826549 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.832414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.835420 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-adee28ea-562f-443b-abf4-88afc9beaa39 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:49.855784 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.888056 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=93cb225b-b3ac-458c-8841-cf7907b9b33c,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:49.899639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:49.912869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.914334 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2969766
Jun 01 18:48:49.917563 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34402) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:49.925127 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'security_group_rule': {'security_group_id': 'd9074e75-527a-4712-b152-f716718c4332', 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:48:49.938387 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:49.946313 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:security_group_rule and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:49.950352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:49.972023 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:49.986767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:49.992794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0750c0bf-eaa6-4430-ad39-eb89e7b05000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:50.006679 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.securitygroups_db [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Project 85f17a1d02ae4454a980be1331cbe34d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:48:50.027839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f8805b0-68bc-4f34-a2e3-e6571742af3a,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:50.037010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:50.037666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.088030 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.092035 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/0f8805b0-68bc-4f34-a2e3-e6571742af3a HTTP/1.1" status: 204  len: 168 time: 0.3709488
Jun 01 18:48:50.098520 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdca6550>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 4, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '82e5e970-63b6-46d7-93d8-ac0c6157f271', 'name': '', 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'mac_address': 'fa:16:3e:f9:cc:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_interface', 'standard_attr_id': 247, 'fixed_ips': [{'subnet_id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:43Z', 'updated_at': '2021-06-01T18:48:49Z', 'revision_number': 4, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'subnets': [{'id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:48:50.103298 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9d02c5-5631-49e2-9cd4-99d9981967f9 None None] The sync data for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi is: [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:48:44Z', 'revision_number': 4, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '82e5e970-63b6-46d7-93d8-ac0c6157f271', 'name': '', 'network_id': 'eb77fbe1-d543-4027-9623-8adf5aa5e9aa', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'mac_address': 'fa:16:3e:f9:cc:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_interface', 'standard_attr_id': 247, 'fixed_ips': [{'subnet_id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:43Z', 'updated_at': '2021-06-01T18:48:49Z', 'revision_number': 4, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'subnets': [{'id': '0686cff7-f6f6-4087-8dd6-308dec1639ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:48:50.129890 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.138037 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.141618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f5860e18-68d1-4943-88db-b1f091909849 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:50.211368 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=915fb7bc-2451-4147-9aa0-e3144e02c987,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:50.218524 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:50.229895 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:48:50.246133 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.246298 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3276563
Jun 01 18:48:50.310939 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9191ebe-75c0-4c7d-842d-f9a329ab64f0 req-c03e497f-64bd-4faf-a2c3-39387c9c5c99 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:50.318274 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9191ebe-75c0-4c7d-842d-f9a329ab64f0 req-c03e497f-64bd-4faf-a2c3-39387c9c5c99 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 943 time: 0.1661229
Jun 01 18:48:50.418905 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9191ebe-75c0-4c7d-842d-f9a329ab64f0 req-471a9fe4-4bdb-4c6a-b7b7-b354c48ae6e4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0901282
Jun 01 18:48:50.629706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd76dc7c-5204-482f-9a73-720a2fb9eaa5 req-7de93d8a-b67e-4ae3-8d8c-29369be939f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:50.632705 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cd76dc7c-5204-482f-9a73-720a2fb9eaa5 req-7de93d8a-b67e-4ae3-8d8c-29369be939f5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1048808
Jun 01 18:48:50.636993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34454) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:50.663072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.682360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:50.688066 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Usage tracker for resource:security_group_rule and tenant:fa4987f8ccfa4572aa54209e30d8de9e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:50.691770 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:50.698380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:50.702950 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cd76dc7c-5204-482f-9a73-720a2fb9eaa5 req-6d4d2e84-9e0c-4b20-b30e-044acfac8920 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0639360
Jun 01 18:48:50.822096 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.826096 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:50.833858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:50.879205 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=fa4987f8ccfa4572aa54209e30d8de9e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2399373
Jun 01 18:48:50.880093 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=537307d2-2bfb-4dfd-9fa0-6087fbe38c6c,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:50.883093 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34470) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:50.883244 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:50.965525 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 00a066ed-ad86-4d31-9083-bf2f681a2c2c details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:48:50.974715 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.011876 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.139811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.147717 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3bd-d2ab-4d01-8c3a-3332a139e818 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:51.184274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=537307d2-2bfb-4dfd-9fa0-6087fbe38c6c,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:51.187897 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:51.193265 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.194755 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/537307d2-2bfb-4dfd-9fa0-6087fbe38c6c HTTP/1.1" status: 204  len: 168 time: 0.3101335
Jun 01 18:48:51.333316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:51.350716 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '00a066ed-ad86-4d31-9083-bf2f681a2c2c', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'port_id': '00a066ed-ad86-4d31-9083-bf2f681a2c2c', 'mac_address': 'fa:16:3e:d6:45:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 92, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b40008fb-ef5f-4ddd-be90-93c9dd2d5423', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:48:51.452318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.475251 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 00a066ed-ad86-4d31-9083-bf2f681a2c2c {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:48:51.491749 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:51.497175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:51.499819 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:51.590728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:51.594053 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:51.634807 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04636fe5-1a4a-48ca-8a54-ca95e6cbb2bb req-9fb04616-1141-413c-9de7-5855bab3dcab tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:51.636777 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-04636fe5-1a4a-48ca-8a54-ca95e6cbb2bb req-9fb04616-1141-413c-9de7-5855bab3dcab tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 944 time: 0.0957403
Jun 01 18:48:51.694659 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-04636fe5-1a4a-48ca-8a54-ca95e6cbb2bb req-e6d72752-47e4-4c12-83c4-f69e9da3e288 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454698
Jun 01 18:48:51.858941 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['00a066ed-ad86-4d31-9083-bf2f681a2c2c'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:48:51.973718 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e8cee3-7957-4f41-a905-1d7ca5b6888c req-e6cd6c3b-df16-465a-afaa-35421785c57c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:51.975425 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04e8cee3-7957-4f41-a905-1d7ca5b6888c req-e6cd6c3b-df16-465a-afaa-35421785c57c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1181357
Jun 01 18:48:52.049020 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 82e5e970-63b6-46d7-93d8-ac0c6157f271 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:52.053484 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04e8cee3-7957-4f41-a905-1d7ca5b6888c req-670aadf3-75ac-4fca-a775-41916206b004 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0714207
Jun 01 18:48:52.220685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:52.226709 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:52.227084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:52.356883 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:52.389483 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 82e5e970-63b6-46d7-93d8-ac0c6157f271, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=82e5e970-63b6-46d7-93d8-ac0c6157f271,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:52.393896 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:52.395720 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:52.470670 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:52.481746 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:52.803660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34552) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:52.920190 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b16edcc-5701-417d-b42c-74a8bc3aebc4 req-a4e1555e-529f-4c6e-af23-862c8940bb88 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:52.929269 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6b16edcc-5701-417d-b42c-74a8bc3aebc4 req-a4e1555e-529f-4c6e-af23-862c8940bb88 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 944 time: 0.1104116
Jun 01 18:48:52.976109 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 00a066ed-ad86-4d31-9083-bf2f681a2c2c up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:52.991714 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6b16edcc-5701-417d-b42c-74a8bc3aebc4 req-27191c58-9264-4bd9-8ead-be14c527aefd tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0611513
Jun 01 18:48:53.093767 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 00a066ed-ad86-4d31-9083-bf2f681a2c2c completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:48:53.107526 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 00a066ed-ad86-4d31-9083-bf2f681a2c2c triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:53.108216 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.110489 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.127096 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:53.131350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Usage tracker for resource:security_group_rule and tenant:f311f122a9d64418bd2ac5def2746f55 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:53.134887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:53.140822 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:53.250181 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.255183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.290990 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f0bc3210-1b60-4917-b9c8-06597061dd76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:53.302066 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=f311f122a9d64418bd2ac5def2746f55&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4963987
Jun 01 18:48:53.304509 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34572) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:53.326413 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d75116a-54c3-4e8a-8c6b-e9e8d962c24c req-5ba9dd67-d80b-4a94-b811-9e014ff1029b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:53.328040 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8d75116a-54c3-4e8a-8c6b-e9e8d962c24c req-5ba9dd67-d80b-4a94-b811-9e014ff1029b tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1227062
Jun 01 18:48:53.359316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.378084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e653783-d730-475f-8854-3c611cde1f7b,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:53.393503 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8d75116a-54c3-4e8a-8c6b-e9e8d962c24c req-7a442a44-9be8-4234-b7f2-59fbff369388 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0577300
Jun 01 18:48:53.407858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:53.411289 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:48:53.414773 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2f82ba5-9603-4dad-b4aa-324aed5bf359" -d '{"events": [{"server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "name": "network-vif-plugged", "status": "completed", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:48:53.427161 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:48:53.428561 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.432047 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.437984 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-028995c9-d09d-4e3b-82d1-3408cb872689 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:53.461407 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.484815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:48:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a253cd2-89b0-4b15-a56a-854bf7c48a0d x-openstack-request-id: req-7a253cd2-89b0-4b15-a56a-854bf7c48a0d {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:48:53.485223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "name": "network-vif-plugged", "status": "completed", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:48:53.485572 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7a253cd2-89b0-4b15-a56a-854bf7c48a0d {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:48:53.486040 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c', 'code': 200}
Jun 01 18:48:53.538253 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.540133 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:53.542611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3d06f017-061f-4ab8-8198-61999e82f137 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:53.543131 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:53.555336 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e653783-d730-475f-8854-3c611cde1f7b,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:53.565373 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:53.577515 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:53.580475 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6e653783-d730-475f-8854-3c611cde1f7b HTTP/1.1" status: 204  len: 168 time: 0.2736516
Jun 01 18:48:53.790379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4376ca73-48b3-45b7-82ac-c8685284e208 req-ed71de4e-356d-4e45-8cfc-915ba6e6dca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:53.792011 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4376ca73-48b3-45b7-82ac-c8685284e208 req-ed71de4e-356d-4e45-8cfc-915ba6e6dca5 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 1098 time: 0.0787740
Jun 01 18:48:53.850811 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4376ca73-48b3-45b7-82ac-c8685284e208 req-1afa3c1d-ab31-4bc9-8663-fc8a86f36745 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501950
Jun 01 18:48:53.932134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 82e5e970-63b6-46d7-93d8-ac0c6157f271 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:48:54.001350 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 82e5e970-63b6-46d7-93d8-ac0c6157f271 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:48:54.001733 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:54.191540 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d5b19-a907-4989-8a28-8313fb14d534 req-d3c62302-4fae-44e7-a413-3b9876910bc2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:54.201226 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d96d5b19-a907-4989-8a28-8313fb14d534 req-d3c62302-4fae-44e7-a413-3b9876910bc2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0962675
Jun 01 18:48:54.248464 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d96d5b19-a907-4989-8a28-8313fb14d534 req-2e357905-5b17-435f-8fb9-dbfd72bf3dcc tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449576
Jun 01 18:48:54.538033 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34624) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:54.640182 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4552a07-1f6e-440e-9d4b-25980892c534 req-bf8ae408-66d1-4c1c-b886-bcc0cb74a5db tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:54.653962 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e4552a07-1f6e-440e-9d4b-25980892c534 req-bf8ae408-66d1-4c1c-b886-bcc0cb74a5db tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1307142
Jun 01 18:48:54.694420 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:54.707988 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e4552a07-1f6e-440e-9d4b-25980892c534 req-763bf258-9878-4fd6-8c1b-0e7488df47d9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529206
Jun 01 18:48:54.733660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:54.738531 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Usage tracker for resource:security_group_rule and tenant:24a9976d62404390995f17cfa2297c97 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:54.741694 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:54.750850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:54.840741 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:54.844707 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:54.853462 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:54.896229 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34636) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:54.896945 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=24a9976d62404390995f17cfa2297c97&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3564742
Jun 01 18:48:54.898674 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24f119a5-bd71-427c-abfd-0a29d8423dc9,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:54.901594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:54.959030 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:54.992739 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:55.053732 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:55.057868 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7071e4b4-9df5-4db0-b59c-3bbe5ed13e98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:55.070173 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24f119a5-bd71-427c-abfd-0a29d8423dc9,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:55.072333 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:55.083514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:55.091653 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/24f119a5-bd71-427c-abfd-0a29d8423dc9 HTTP/1.1" status: 204  len: 168 time: 0.1899049
Jun 01 18:48:55.515156 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574ae431-b821-4d77-8b18-854ea1e2d5c2 req-47e2e60a-1dc0-4643-b388-b08677acd4ef tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:55.516764 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-574ae431-b821-4d77-8b18-854ea1e2d5c2 req-47e2e60a-1dc0-4643-b388-b08677acd4ef tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.1611402
Jun 01 18:48:55.562300 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-574ae431-b821-4d77-8b18-854ea1e2d5c2 req-6ff141da-9613-412a-b258-318e51ab965d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389152
Jun 01 18:48:56.015997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49169678-4435-4333-9296-24674f62ab4d req-5eb39e66-7779-4ae4-ace9-3ac212143740 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:56.017886 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-49169678-4435-4333-9296-24674f62ab4d req-5eb39e66-7779-4ae4-ace9-3ac212143740 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0835996
Jun 01 18:48:56.067573 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-49169678-4435-4333-9296-24674f62ab4d req-c09b84d0-15ce-40db-8489-e04da38ec81c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429394
Jun 01 18:48:56.695785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34722) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:56.816983 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:56.831060 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:56.835481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Usage tracker for resource:security_group_rule and tenant:06d2628a4ec7417f9941252773e34d0f is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:56.838375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:56.844681 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:56.934040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:56.937851 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:56.947632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-edbbed19-73b0-4119-a6e0-c84365cc4d11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:56.991539 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=06d2628a4ec7417f9941252773e34d0f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2946374
Jun 01 18:48:56.993223 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb24bbaf-b776-4840-9ac3-5167d782ba2f,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:56.994246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34732) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:56.997223 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:57.057078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:57.085706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:57.140366 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:57.145823 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cae67e3f-00fc-442f-ae96-55fbb8ddfda7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:57.161453 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb24bbaf-b776-4840-9ac3-5167d782ba2f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:57.165268 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:57.176152 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:57.177645 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/fb24bbaf-b776-4840-9ac3-5167d782ba2f HTTP/1.1" status: 204  len: 168 time: 0.1824195
Jun 01 18:48:57.270830 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34d3c63-ef87-4367-9592-a892b41fc522 req-2c15e1c1-56af-450e-a23e-7319963bab33 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:57.272629 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c34d3c63-ef87-4367-9592-a892b41fc522 req-2c15e1c1-56af-450e-a23e-7319963bab33 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0818379
Jun 01 18:48:57.323296 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c34d3c63-ef87-4367-9592-a892b41fc522 req-803a2c98-d8d6-4c43-902f-b40ce5432bdf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443115
Jun 01 18:48:57.921601 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-159596d8-a047-4c0b-9e0f-179fec855ea2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:57.923460 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-159596d8-a047-4c0b-9e0f-179fec855ea2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.1690719
Jun 01 18:48:57.953918 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-592d0d1b-dd33-4eff-86af-876cd52e4255 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/quotas/ab05a0b11f6c4dc5b84c7c8e30bafa9d HTTP/1.1" status: 200  len: 375 time: 0.0155559
Jun 01 18:48:58.075406 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-f8030420-5ef9-4ec9-aa96-6f15827968ba tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1156199
Jun 01 18:48:58.231345 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-ac83980f-20de-4e2e-b628-f1c072d492b9 service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1544862
Jun 01 18:48:58.367661 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-6c611862-4e03-4f6a-abbf-6be603689183 service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303966
Jun 01 18:48:58.564659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ae1537-86c8-4212-a66b-0d871fe3282f req-012dd0cd-e476-4cff-8c97-67f1b1cc13e3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:58.567210 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c5ae1537-86c8-4212-a66b-0d871fe3282f req-012dd0cd-e476-4cff-8c97-67f1b1cc13e3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1175663
Jun 01 18:48:58.577109 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-78c8f796-4db4-4f57-b80a-55f4b671c2c8 req-729eed12-21cd-48fa-902a-336139a95f52 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 210 time: 0.0562327
Jun 01 18:48:58.629089 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c5ae1537-86c8-4212-a66b-0d871fe3282f req-5937f96c-fcef-4a96-8262-6165366dca79 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0516818
Jun 01 18:48:59.119075 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34820) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:59.244766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.259461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:48:59.265360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Usage tracker for resource:security_group_rule and tenant:5c8ad6a102be4138ae7cb0d618a663ab is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:48:59.268246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:48:59.275012 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:48:59.368758 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.375578 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.386391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:59.428445 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=5c8ad6a102be4138ae7cb0d618a663ab&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3081148
Jun 01 18:48:59.430110 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20a74964-f487-4029-b8e8-658d89f7279e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:59.431302 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34836) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:48:59.433461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:59.499648 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.529607 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.738890 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6188206c-8c87-42cf-a2b5-b481e4ce234a req-79c4b60a-3bdc-4243-bb88-2f2022c3d1be tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 210 time: 0.0491631
Jun 01 18:48:59.825304 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:48:59.841122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-265f6d89-b45d-46e1-b5db-765d0a3730b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:48:59.863530 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20a74964-f487-4029-b8e8-658d89f7279e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:48:59.902301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-9f9b7256-8b85-4e5e-be3b-4fca1a9c1ed0 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:48:59.903688 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-9f9b7256-8b85-4e5e-be3b-4fca1a9c1ed0 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.3269691
Jun 01 18:48:59.906130 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:48:59.924434 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Request body: {'port': {'device_id': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'admin_state_up': True, 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:00.008839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.009835 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/20a74964-f487-4029-b8e8-658d89f7279e HTTP/1.1" status: 204  len: 168 time: 0.5775511
Jun 01 18:49:00.103226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6e7575-ab72-492c-b5e6-7647debd862e req-951a6659-9a83-4caf-b683-a1c5be71d940 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:00.104690 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fd6e7575-ab72-492c-b5e6-7647debd862e req-951a6659-9a83-4caf-b683-a1c5be71d940 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.3262177
Jun 01 18:49:00.186356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:00.196557 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:00.212212 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fd6e7575-ab72-492c-b5e6-7647debd862e req-7515846e-f73b-41fd-a553-6b65ecc2694f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0993481
Jun 01 18:49:00.213352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:00.216660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.399424 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34868) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:00.417025 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.432541 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:00.436640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Usage tracker for resource:security_group_rule and tenant:853f80d9335a4c089855570556d77abf is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:00.439657 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:00.447128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:00.458814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Allocated IP 172.20.0.2 (2bc7607a-0e83-4423-b9b7-ac3e13607a13/b40008fb-ef5f-4ddd-be90-93c9dd2d5423/4878da57-0d45-4191-82df-acc476090da6) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:00.561015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.565870 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.574453 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-737a0139-e7f2-4464-b620-c59b65f66358 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:00.620963 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=853f80d9335a4c089855570556d77abf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2174134
Jun 01 18:49:00.620963 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f5ed2be-1496-47a8-b7b5-878d10ed27f0,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:00.624314 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34876) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:00.644896 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:00.696314 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.699291 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.733029 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.734922 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.741173 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:00.759979 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256', '00a066ed-ad86-4d31-9083-bf2f681a2c2c'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:00.820233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.824895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:00.828122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:00.828849 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a3b00775-2e23-471e-b7cd-f629cc0585b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:00.830792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:00.843838 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f5ed2be-1496-47a8-b7b5-878d10ed27f0,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:00.846735 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:00.855842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.859899 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/0f5ed2be-1496-47a8-b7b5-878d10ed27f0 HTTP/1.1" status: 204  len: 168 time: 0.2296600
Jun 01 18:49:00.883217 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event updated for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:00.903615 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:00.937370 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:00.938897 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:00.973207 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0536335
Jun 01 18:49:00.986857 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528060e1-2c66-4dbb-ae9d-857306933da2 req-3940511e-b6f0-4886-86ca-09cdea6dcda5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:00.989739 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Request body: {'port': {'device_id': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:00.994422 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-528060e1-2c66-4dbb-ae9d-857306933da2 req-3940511e-b6f0-4886-86ca-09cdea6dcda5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 931 time: 0.1083753
Jun 01 18:49:01.053972 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-528060e1-2c66-4dbb-ae9d-857306933da2 req-c65eddf3-b129-4341-9a41-3992874f5269 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546386
Jun 01 18:49:01.121952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:01.482541 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe48269-e04f-4897-905c-e60a7951210e req-1669e865-31fc-4372-8763-66131a27b989 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:01.484037 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0fe48269-e04f-4897-905c-e60a7951210e req-1669e865-31fc-4372-8763-66131a27b989 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1210485
Jun 01 18:49:01.594211 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0fe48269-e04f-4897-905c-e60a7951210e req-64f0cd3a-43d6-4735-9ab4-bb766bca0ccf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0997462
Jun 01 18:49:01.596040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4878da57-0d45-4191-82df-acc476090da6 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:01.606167 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:01.623495 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Transition to ACTIVE for port object 4878da57-0d45-4191-82df-acc476090da6 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:01.629365 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:01.641120 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:01.807187 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Pushing event updated for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:01.869341 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:01.935747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Attempting to bind port 4878da57-0d45-4191-82df-acc476090da6 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:01.936091 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Attempting to bind port 4878da57-0d45-4191-82df-acc476090da6 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:01.936419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Attempting to bind port 4878da57-0d45-4191-82df-acc476090da6 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:01.943977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Port 4878da57-0d45-4191-82df-acc476090da6 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:49:01.944303 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Attempting to bind port 4878da57-0d45-4191-82df-acc476090da6 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:01.952570 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:01.952907 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Checking segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:01.953290 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Bound using segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:01.953718 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Bound port: 4878da57-0d45-4191-82df-acc476090da6, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:01.954071 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:01.964738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4519737a-0cff-4f52-9941-b2ad2cc8aab4 req-4e55478e-3841-4e81-b9b5-5e8297f556f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:01.966243 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4519737a-0cff-4f52-9941-b2ad2cc8aab4 req-4e55478e-3841-4e81-b9b5-5e8297f556f4 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1098 time: 0.1568978
Jun 01 18:49:02.151868 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4519737a-0cff-4f52-9941-b2ad2cc8aab4 req-8c2bd5c1-3361-4595-b1c3-9f3d7d1bd0b8 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1751237
Jun 01 18:49:02.174027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:02.178362 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4878da57-0d45-4191-82df-acc476090da6,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:02.215481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:02.225862 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:02.298771 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:02.299688 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:02.301157 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] 10.222.0.25 "PUT /v2.0/ports/4878da57-0d45-4191-82df-acc476090da6 HTTP/1.1" status: 200  len: 1093 time: 1.3182271
Jun 01 18:49:02.304533 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'tag': '4878da57-0d45-4191-82df-acc476090da6'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:02.306562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6" -d '{"events": [{"name": "network-changed", "server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "tag": "4878da57-0d45-4191-82df-acc476090da6"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:02.375043 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c95fff4-fcba-4348-9830-f49b1a26e49c x-openstack-request-id: req-0c95fff4-fcba-4348-9830-f49b1a26e49c {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:02.375572 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "tag": "4878da57-0d45-4191-82df-acc476090da6", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:02.375734 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-0c95fff4-fcba-4348-9830-f49b1a26e49c {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:02.376233 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'tag': '4878da57-0d45-4191-82df-acc476090da6', 'status': 'completed', 'code': 200}
Jun 01 18:49:02.377820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Pushing event updated for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:02.416068 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:02.440100 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc227ae-8d38-4189-a191-a823dcd6a1b7 req-540fce5a-56a4-48c8-aa64-44d86404f827 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:02.440894 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-1cc227ae-8d38-4189-a191-a823dcd6a1b7 req-540fce5a-56a4-48c8-aa64-44d86404f827 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:02.478514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-1cc227ae-8d38-4189-a191-a823dcd6a1b7 req-540fce5a-56a4-48c8-aa64-44d86404f827 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:02.480048 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1cc227ae-8d38-4189-a191-a823dcd6a1b7 req-540fce5a-56a4-48c8-aa64-44d86404f827 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 943 time: 0.3003373
Jun 01 18:49:02.508040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-60b60fa8-1a3b-4d4b-8039-ce6e2f41ea4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:02.509558 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-60b60fa8-1a3b-4d4b-8039-ce6e2f41ea4c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 1096 time: 0.1286654
Jun 01 18:49:02.593185 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-d26cfe36-b700-4c22-ae87-6918a6ac653d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4878da57-0d45-4191-82df-acc476090da6 HTTP/1.1" status: 200  len: 217 time: 0.0752654
Jun 01 18:49:02.606277 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1cc227ae-8d38-4189-a191-a823dcd6a1b7 req-ba4854ed-33fb-45d9-97d7-88b1bb0f6865 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1198421
Jun 01 18:49:02.683950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-81168b81-02c4-47a8-9c8a-cd5ad83c3e95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:02.685873 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-81168b81-02c4-47a8-9c8a-cd5ad83c3e95 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.0835631
Jun 01 18:49:02.754491 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-1d380a90-54ae-40d6-a90c-04597ee23e72 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0590186
Jun 01 18:49:02.873885 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a674e9-d730-42db-9b9e-803860cd1756 req-c3d6fbd0-4d4f-477a-ab2d-5cf6c628472a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:02.883646 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-45a674e9-d730-42db-9b9e-803860cd1756 req-c3d6fbd0-4d4f-477a-ab2d-5cf6c628472a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1119790
Jun 01 18:49:02.931039 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-d30862fd-08b6-4936-9e86-6c1435b43d78 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1695600
Jun 01 18:49:02.933023 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-45a674e9-d730-42db-9b9e-803860cd1756 req-104094d0-cef9-41c6-87d0-97a8409cbbb9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481193
Jun 01 18:49:02.937248 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34958) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:03.069152 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.087787 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:03.089164 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72b0cf8b-9cd5-47a7-9e82-13b05f7a7a50 req-5056fbe9-1362-4635-aaf0-bc021c7c0bbf service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1498020
Jun 01 18:49:03.091684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Usage tracker for resource:security_group_rule and tenant:5b2db1586aed400dac88b0febba9a034 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:03.094816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:03.101122 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:03.202475 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.208573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.227231 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:03.241170 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-874d3763-c01c-49f2-a814-2a835b0686a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:03.243268 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-874d3763-c01c-49f2-a814-2a835b0686a5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 1096 time: 0.0758140
Jun 01 18:49:03.283740 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=5b2db1586aed400dac88b0febba9a034&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3452551
Jun 01 18:49:03.285499 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=021bec80-fe13-436e-99c3-49152eaa2b6f,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:03.293630 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:03.294042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34966) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:03.373035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.407281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.432740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-2c0c9f8b-51e0-4ee1-ae87-b3c7636c32a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:03.434230 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-2c0c9f8b-51e0-4ee1-ae87-b3c7636c32a2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 915 time: 0.1765163
Jun 01 18:49:03.460719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.464189 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:03.475298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=021bec80-fe13-436e-99c3-49152eaa2b6f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:03.479149 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:03.489858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.492471 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/021bec80-fe13-436e-99c3-49152eaa2b6f HTTP/1.1" status: 204  len: 168 time: 0.1959064
Jun 01 18:49:03.510721 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-414fcb59-d755-464b-9839-af269716a6d2 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4878da57-0d45-4191-82df-acc476090da6 HTTP/1.1" status: 200  len: 217 time: 0.0649521
Jun 01 18:49:03.576516 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-0149cee8-3c4c-4d1d-8873-7234d3eef00e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:03.577931 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-0149cee8-3c4c-4d1d-8873-7234d3eef00e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.0565696
Jun 01 18:49:03.631948 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-09c9aa32-927e-4b74-9d82-1a1339e9ca62 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0438745
Jun 01 18:49:03.822697 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-8fc15b77-0fc7-42e8-80fd-5df7d6eb9db0 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1807809
Jun 01 18:49:03.849026 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 34978) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:03.873087 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:03.892743 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:03.898381 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Usage tracker for resource:security_group_rule and tenant:2267a37c9d084489abc74923c7bd0787 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:03.902441 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:03.909349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:03.932692 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df987bf-ec5e-427e-a719-28ebdcc0b0f3 req-954407fa-5498-471e-b4c2-15e3a066fff9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:03.934432 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df987bf-ec5e-427e-a719-28ebdcc0b0f3 req-954407fa-5498-471e-b4c2-15e3a066fff9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 943 time: 0.1413560
Jun 01 18:49:03.975631 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1efbe9b2-7ef2-43b9-9241-a0ae58bc16d6 req-61417431-c14a-41e1-81d2-0eb8a7814232 service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1449194
Jun 01 18:49:04.000278 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df987bf-ec5e-427e-a719-28ebdcc0b0f3 req-edbad218-7ad3-4621-a3b2-bfe928522282 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581756
Jun 01 18:49:04.057417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.061220 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.069841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1cae2fb1-4875-4e74-be7d-43e0870f32ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:04.216656 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=2267a37c9d084489abc74923c7bd0787&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3665543
Jun 01 18:49:04.219235 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 34984) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:04.219852 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acb13ec0-fec3-4dee-b1e9-a85ce04e2444,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:04.223912 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:04.255368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185a4689-59d9-42c5-9963-e52b7f43db38 req-1929890a-37de-46c3-817d-597b995be042 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:04.256881 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-185a4689-59d9-42c5-9963-e52b7f43db38 req-1929890a-37de-46c3-817d-597b995be042 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1147120
Jun 01 18:49:04.276938 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.305146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.305450 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-185a4689-59d9-42c5-9963-e52b7f43db38 req-39dea88b-6f03-490d-9c03-a3f87b26899a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429311
Jun 01 18:49:04.357875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.361751 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-aa8e6c7b-6ac2-4fe7-8f79-ffcaebee9f81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:04.374091 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acb13ec0-fec3-4dee-b1e9-a85ce04e2444,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:04.376884 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:04.379644 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.380695 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/acb13ec0-fec3-4dee-b1e9-a85ce04e2444 HTTP/1.1" status: 204  len: 168 time: 0.1604342
Jun 01 18:49:04.594548 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9a0fea-065c-4452-8fd5-15956002de1f req-72db3a7d-e110-4047-b3b7-8c525b45d0f7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:04.596381 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2b9a0fea-065c-4452-8fd5-15956002de1f req-72db3a7d-e110-4047-b3b7-8c525b45d0f7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1677558
Jun 01 18:49:04.646191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2b9a0fea-065c-4452-8fd5-15956002de1f req-5659398b-35bb-4fde-9053-d8cecaeca9ee tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424881
Jun 01 18:49:04.780985 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35002) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:04.801618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.823081 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:04.827168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Usage tracker for resource:security_group_rule and tenant:e2c9996028304716b24e5aca2bae897c is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:04.830447 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:04.838168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:04.944710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.949767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:04.984703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1b2149c7-75b5-467b-b1f3-0aa68631ee20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:04.994491 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=e2c9996028304716b24e5aca2bae897c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2121212
Jun 01 18:49:04.997960 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35010) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:05.077484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce01643a-fd2f-4da9-a8fd-18f39dc171b6,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:05.089628 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:05.160298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:05.191501 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:05.256629 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:05.262209 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-230a69d3-0079-45d7-ba08-79b0c5ff0d44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:05.275879 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce01643a-fd2f-4da9-a8fd-18f39dc171b6,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:05.279293 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:05.284712 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:05.288580 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ce01643a-fd2f-4da9-a8fd-18f39dc171b6 HTTP/1.1" status: 204  len: 168 time: 0.2893426
Jun 01 18:49:05.297593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ce6be5-741e-47c7-9196-926d3f86833f req-a5b8997d-ee3a-484a-a5f9-0cb2a219d87f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:05.304933 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04ce6be5-741e-47c7-9196-926d3f86833f req-a5b8997d-ee3a-484a-a5f9-0cb2a219d87f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 943 time: 0.1054943
Jun 01 18:49:05.344554 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04ce6be5-741e-47c7-9196-926d3f86833f req-830bd75d-637c-4736-bd9e-adc8b73da08d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386062
Jun 01 18:49:06.619320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1054548-ed97-4420-8eb7-5e58cc1bc56e req-c2b77dfc-ae3f-4331-b173-db4df46aad8b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:06.626511 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1054548-ed97-4420-8eb7-5e58cc1bc56e req-c2b77dfc-ae3f-4331-b173-db4df46aad8b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 943 time: 0.1044614
Jun 01 18:49:06.685556 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1054548-ed97-4420-8eb7-5e58cc1bc56e req-dbe3ea85-ffb4-48f0-bcf0-df2dcfa2f6a4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0575955
Jun 01 18:49:06.820022 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-3e1bc7ff-4b86-4bc0-977e-df96a2c7cbb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:06.822061 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-3e1bc7ff-4b86-4bc0-977e-df96a2c7cbb2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.1159911
Jun 01 18:49:06.993865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-25367784-ea90-4f28-bc29-1be98049c4a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:06.995638 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-25367784-ea90-4f28-bc29-1be98049c4a5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.1637928
Jun 01 18:49:06.996296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b727d9f5-963f-49b8-a67f-d723e463a73b req-33b8f0f5-dc18-47b2-b63d-a86a7c6c9737 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:07.000901 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b727d9f5-963f-49b8-a67f-d723e463a73b req-33b8f0f5-dc18-47b2-b63d-a86a7c6c9737 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1005864
Jun 01 18:49:07.048342 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b727d9f5-963f-49b8-a67f-d723e463a73b req-98a4034e-c5c7-455e-8be6-a376e4ad152e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449393
Jun 01 18:49:07.071510 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-b9ec4b78-b347-4ef5-8de7-60b15a9dca6c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.0680215
Jun 01 18:49:07.077629 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 4878da57-0d45-4191-82df-acc476090da6 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:49:07.162594 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-87b0532c-1b1c-4359-8551-6050ee34fc98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:07.164875 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-87b0532c-1b1c-4359-8551-6050ee34fc98 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0816381
Jun 01 18:49:07.221778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4878da57-0d45-4191-82df-acc476090da6,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:07.229974 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-e30f3417-68a5-4b1e-a443-58fa30912849 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0574386
Jun 01 18:49:07.236420 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '4878da57-0d45-4191-82df-acc476090da6', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'port_id': '4878da57-0d45-4191-82df-acc476090da6', 'mac_address': 'fa:16:3e:81:52:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 92, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b40008fb-ef5f-4ddd-be90-93c9dd2d5423', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:49:07.300824 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:07.318687 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4878da57-0d45-4191-82df-acc476090da6 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:07.334231 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4878da57-0d45-4191-82df-acc476090da6,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:07.338972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:07.341502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:07.376711 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-9563304c-ae40-4842-96c3-b0f10d60490d service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1381183
Jun 01 18:49:07.414646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:07.418003 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:07.519930 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac6b6232-62c8-4bc5-a4d1-19c6c615ca85 req-2311993b-6518-423e-90b0-9af0666968ef service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1305745
Jun 01 18:49:07.731992 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['4878da57-0d45-4191-82df-acc476090da6'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:07.873950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9c6b06-4026-402f-b4da-0392faa47e8b req-86c6cf67-3ca4-4ea6-80d6-37dfa0b6654f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:07.875426 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4c9c6b06-4026-402f-b4da-0392faa47e8b req-86c6cf67-3ca4-4ea6-80d6-37dfa0b6654f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 944 time: 0.0824811
Jun 01 18:49:07.944481 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4c9c6b06-4026-402f-b4da-0392faa47e8b req-85f39782-aa41-4ab0-a9ff-e38b222a7b86 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494208
Jun 01 18:49:08.268458 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a54395c-3200-4ec4-91c6-da6e5a807879 req-efe8ba53-231b-473a-90e1-e37825acd47f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:08.280866 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a54395c-3200-4ec4-91c6-da6e5a807879 req-efe8ba53-231b-473a-90e1-e37825acd47f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1090376
Jun 01 18:49:08.334139 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a54395c-3200-4ec4-91c6-da6e5a807879 req-523c5bfe-e982-4600-9e8d-e6a316dd7712 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0521166
Jun 01 18:49:09.050834 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:09.085316 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 4878da57-0d45-4191-82df-acc476090da6 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:09.129094 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9c1525-ce2a-4ad6-8c55-bcca84c7ad8b req-1cd02a4f-c695-4f18-a662-397cbca691ea tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:09.130581 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c9c1525-ce2a-4ad6-8c55-bcca84c7ad8b req-1cd02a4f-c695-4f18-a662-397cbca691ea tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 944 time: 0.0886807
Jun 01 18:49:09.151517 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 4878da57-0d45-4191-82df-acc476090da6 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:09.156388 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 4878da57-0d45-4191-82df-acc476090da6 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:09.156822 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:09.173843 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c9c1525-ce2a-4ad6-8c55-bcca84c7ad8b req-03d2797a-c5c0-417d-b8b3-2490322e309e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374768
Jun 01 18:49:09.274605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:09.300834 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4878da57-0d45-4191-82df-acc476090da6'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:09.303135 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d428a4b-bf73-49d8-87e6-fd66db073002" -d '{"events": [{"server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "name": "network-vif-plugged", "status": "completed", "tag": "4878da57-0d45-4191-82df-acc476090da6"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:09.317584 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4878da57-0d45-4191-82df-acc476090da6,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:09.329586 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:09.332515 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:09.382997 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b7c0657-89c1-4495-b4a8-61cad8c3a1bd x-openstack-request-id: req-7b7c0657-89c1-4495-b4a8-61cad8c3a1bd {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:09.383340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "name": "network-vif-plugged", "status": "completed", "tag": "4878da57-0d45-4191-82df-acc476090da6", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:09.383615 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7b7c0657-89c1-4495-b4a8-61cad8c3a1bd {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:09.384002 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4878da57-0d45-4191-82df-acc476090da6', 'code': 200}
Jun 01 18:49:09.455250 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:09.458421 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:09.599931 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac988c71-8dea-4d3b-a94a-7e2160fbb034 req-218f3be9-6de5-40ef-b630-cacde4b34b28 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:09.601417 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac988c71-8dea-4d3b-a94a-7e2160fbb034 req-218f3be9-6de5-40ef-b630-cacde4b34b28 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1070428
Jun 01 18:49:09.699983 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ac988c71-8dea-4d3b-a94a-7e2160fbb034 req-479bf3c8-6e73-4f31-835b-813afdb8902e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0927262
Jun 01 18:49:09.732292 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f17d520-d195-48cf-98bb-bc162d993457 req-78e055ab-ce5a-43ff-b190-5a5ebdc3b6d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:09.735841 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f17d520-d195-48cf-98bb-bc162d993457 req-78e055ab-ce5a-43ff-b190-5a5ebdc3b6d8 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 1098 time: 0.1089780
Jun 01 18:49:09.796600 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f17d520-d195-48cf-98bb-bc162d993457 req-c15a30de-63da-48a5-a8af-b927313375e9 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451086
Jun 01 18:49:10.364532 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7917b9f0-44ef-4666-bd50-09ab2fa0c686 req-d09c1df7-358f-4384-b1f3-ad8c87d7cc6d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:10.366719 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7917b9f0-44ef-4666-bd50-09ab2fa0c686 req-d09c1df7-358f-4384-b1f3-ad8c87d7cc6d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.0864356
Jun 01 18:49:10.413568 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7917b9f0-44ef-4666-bd50-09ab2fa0c686 req-85a0b551-3cef-4efd-ab5b-68a98d6b8921 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412033
Jun 01 18:49:10.891880 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5ea9af-7199-4b88-851d-b700f8e4e109 req-ac7b7676-7ef5-48a8-97bc-39e28709d2c6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:10.893340 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4f5ea9af-7199-4b88-851d-b700f8e4e109 req-ac7b7676-7ef5-48a8-97bc-39e28709d2c6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0778182
Jun 01 18:49:10.937132 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4f5ea9af-7199-4b88-851d-b700f8e4e109 req-ec707dad-fe4f-49a7-b80d-eaba2908ab18 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378232
Jun 01 18:49:11.373445 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35222) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:11.489445 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.503935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:11.508343 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Usage tracker for resource:security_group_rule and tenant:29ac155cfa5b4114bda9fb08fa7a76fa is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:11.511076 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:11.516705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:11.622559 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.626887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.653283 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-93d717c9-bb0e-470f-b559-e3f9f7286012 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:11.670176 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=29ac155cfa5b4114bda9fb08fa7a76fa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2955658
Jun 01 18:49:11.677016 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35230) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:11.685466 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12578cba-375f-4d63-9be4-dc2f6449a25f req-81287363-83de-4839-944b-6f94ea48e2fa tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:11.687025 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-12578cba-375f-4d63-9be4-dc2f6449a25f req-81287363-83de-4839-944b-6f94ea48e2fa tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.1658492
Jun 01 18:49:11.698656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=264688b5-8c77-43f2-afa6-75cd8a80c3e8,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:11.717103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.717465 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.717841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.718198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.718553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.719367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.719367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.719581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.720127 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.720497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.720862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.721211 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:11.727716 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:11.737893 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-12578cba-375f-4d63-9be4-dc2f6449a25f req-c61e8fd0-8b6d-41fe-a67d-a311c14803db tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438583
Jun 01 18:49:11.759772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.787262 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.840776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.845944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ec4214f5-32c2-4ae8-901e-083a56ef7cef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:11.856573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=264688b5-8c77-43f2-afa6-75cd8a80c3e8,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:11.860972 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:11.863475 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:11.867547 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/264688b5-8c77-43f2-afa6-75cd8a80c3e8 HTTP/1.1" status: 204  len: 168 time: 0.1893952
Jun 01 18:49:12.151210 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b449932-4884-4f99-a103-04211c25fef0 req-563c01d0-f198-4d31-b39a-f97624ac7579 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:12.153267 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9b449932-4884-4f99-a103-04211c25fef0 req-563c01d0-f198-4d31-b39a-f97624ac7579 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1096401
Jun 01 18:49:12.219958 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9b449932-4884-4f99-a103-04211c25fef0 req-7ab37ea8-e26d-4c08-9b49-77f1c552f6ef tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599258
Jun 01 18:49:12.220102 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35248) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:12.236524 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.252366 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:12.256985 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Usage tracker for resource:security_group_rule and tenant:93d949f027904b32a699be2d7047972c is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:12.259715 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:12.265405 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:12.347340 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.350227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.358346 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ab6cd1b0-1725-41d1-8746-bea8af17b34a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:12.396331 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=93d949f027904b32a699be2d7047972c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1751614
Jun 01 18:49:12.398145 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=250385cf-cea0-429c-9a90-c9b8d7cc2a6b,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:12.399197 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35250) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:12.401142 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:12.461841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.487390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.541606 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.546239 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4368edd3-cf0e-4e52-bbd9-83196d756df4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:12.559652 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=250385cf-cea0-429c-9a90-c9b8d7cc2a6b,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:12.563366 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:12.568300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.571823 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/250385cf-cea0-429c-9a90-c9b8d7cc2a6b HTTP/1.1" status: 204  len: 168 time: 0.1695168
Jun 01 18:49:12.917688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35266) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:12.937048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:12.953601 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:12.957882 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Usage tracker for resource:security_group_rule and tenant:49bb916a73db45ccab5687c32d1cf170 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:12.960710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:12.966391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:13.049287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.052687 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.059665 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:13.100318 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7d05fc3-9fe9-4ad9-92bd-3399a0ea3ccd,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:13.104593 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=49bb916a73db45ccab5687c32d1cf170&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1857846
Jun 01 18:49:13.105548 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:13.107056 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35268) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:13.165856 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.190848 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.252442 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.258061 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ff47042-da9c-4d33-be35-5d093fc5e195 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:13.270024 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7d05fc3-9fe9-4ad9-92bd-3399a0ea3ccd,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:13.273198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:13.275307 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:13.278723 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/a7d05fc3-9fe9-4ad9-92bd-3399a0ea3ccd HTTP/1.1" status: 204  len: 168 time: 0.1684833
Jun 01 18:49:13.439256 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f674f5-416c-459f-838b-e4435bdf49a5 req-c216543f-5766-4c00-9fa4-f20a983ddb1d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:13.440819 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2f674f5-416c-459f-838b-e4435bdf49a5 req-c216543f-5766-4c00-9fa4-f20a983ddb1d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0970559
Jun 01 18:49:13.494883 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2f674f5-416c-459f-838b-e4435bdf49a5 req-d9a6da95-a52c-4177-9da5-0f3ca76a7dad tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470288
Jun 01 18:49:14.061133 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35318) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:14.124827 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d8e9111-8402-4ea3-8704-26313903dc99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.133881 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-40e54816-312a-4c73-a4cd-b175ea388b36 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1231457379&fields=id&tenant_id=85f17a1d02ae4454a980be1331cbe34d HTTP/1.1" status: 200  len: 267 time: 0.0660853
Jun 01 18:49:14.264446 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35324) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:14.305818 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.317501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-415914440-network', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:14.321509 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-e42ff714-1244-4bb2-ad2b-8fa6549c33df tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:14.321924 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:14.324002 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-e42ff714-1244-4bb2-ad2b-8fa6549c33df tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 809 time: 0.1826193
Jun 01 18:49:14.326169 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Usage tracker for resource:network and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:14.329511 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:14.331911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:14.335916 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:14.340934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Usage tracker for resource:security_group_rule and tenant:4f3f41ea55a6490799e6a4fff8524416 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:14.344648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:14.345886 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Made reservation on behalf of 35f75df4cb564b1dad14fd0d02d3c46b for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:14.349045 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-2518a8c3-906a-4cb1-8088-d71f41206b2c tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/quotas/85f17a1d02ae4454a980be1331cbe34d HTTP/1.1" status: 200  len: 375 time: 0.0195322
Jun 01 18:49:14.349596 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.352541 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:14.361658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.391965 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:14.396540 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:14.399674 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:14.405540 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:14.474391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3ba43e2f-4b9f-42c1-8265-f8d1e0b997ff tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Synchronizing usage tracker for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:14.499536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.504401 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.509527 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f3468d9a-500e-44d8-8fc4-cc98534207a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:14.519724 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3ba43e2f-4b9f-42c1-8265-f8d1e0b997ff tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Unset dirty status for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:14.521140 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3ba43e2f-4b9f-42c1-8265-f8d1e0b997ff tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1653175
Jun 01 18:49:14.525744 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.530493 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.535958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] vlan segment allocate from pool success with {'vlan_id': 67, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:49:14.541152 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:14.548540 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ec7d009-a5f3-4e97-b404-46080b7ac538,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:14.552046 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:14.554812 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.555156 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Added segment 86c79fa1-5094-40ad-b6c7-ef8a27fb32b7 of type vlan for network 4a9f474a-dc9d-475e-847d-0ea358045ed8
Jun 01 18:49:14.587814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.622635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e313ceef-6123-4878-b3ed-74f6cd82ba44,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:14.626816 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=4f3f41ea55a6490799e6a4fff8524416&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5645518
Jun 01 18:49:14.629784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:14.629915 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35332) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:14.662445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.695358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:14.695935 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.699244 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6c0cbfd-821b-4675-ad5b-7b58a296b1f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:14.718283 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-f88b68a2-8b92-477d-80be-32fa197628b5 service neutron] 10.222.0.22 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1779590
Jun 01 18:49:14.852591 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3d0fb839-1ba5-4c6c-ad27-e17dd746e76a service neutron] 10.222.0.22 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1270604
Jun 01 18:49:14.861437 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.864803 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Pushing event updated for resources: {'Network': ['ID=4a9f474a-dc9d-475e-847d-0ea358045ed8,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:14.867516 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:14.873028 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.6045191
Jun 01 18:49:14.874266 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35334) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:14.875664 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:49:14.879723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Request body: {'subnet': {'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-415914440-subnet', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:14.885302 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:14.890832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Usage tracker for resource:subnet and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:14.894315 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:14.901256 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:14.901621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.916114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Made reservation on behalf of 35f75df4cb564b1dad14fd0d02d3c46b for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:14.919188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2101686'] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:14.923578 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef92cb1-f142-4a42-8d94-8af94e361c39 req-6dd0c4ad-f578-4758-a08e-0dfb3ae67333 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:14.925694 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ef92cb1-f142-4a42-8d94-8af94e361c39 req-6dd0c4ad-f578-4758-a08e-0dfb3ae67333 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2638779
Jun 01 18:49:14.999413 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ef92cb1-f142-4a42-8d94-8af94e361c39 req-cd768e99-bd7c-454c-a908-b2432d53c895 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0665157
Jun 01 18:49:15.020030 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.022218 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fae22f7d-f2aa-4279-9957-90f1dc543231 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:15.038504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e313ceef-6123-4878-b3ed-74f6cd82ba44,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:15.040743 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:15.044385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.045585 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/e313ceef-6123-4878-b3ed-74f6cd82ba44 HTTP/1.1" status: 204  len: 168 time: 0.4148834
Jun 01 18:49:15.401158 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35354) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:15.421536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.434365 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-335c591d-7205-4886-9e2e-6006a72f56c9 req-9457eb20-cc57-47f3-8f1e-178d3a4583fc tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 210 time: 0.0531013
Jun 01 18:49:15.446041 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:15.450503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Usage tracker for resource:security_group_rule and tenant:4b18f43a4a2c4f619dc9dee9ce3e7a8f is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:15.453623 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:15.461780 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:15.540455 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1394273', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2101636'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.546185 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:15.547115 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.551285 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.560224 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fa8278b8-0cfd-4513-82c7-2e771b20f35a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:15.607993 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=4b18f43a4a2c4f619dc9dee9ce3e7a8f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2037518
Jun 01 18:49:15.607993 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0beebc0-bf99-48b2-b9cc-f1f6e41d031c,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:15.609760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35364) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:15.623425 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dead668a-1f23-483d-a130-8fd712cb633f,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:15.629717 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:15.630679 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.631045 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.631414 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.631725 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.633001 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Checking segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:15.633001 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Network hostable DHCP agents. Network: 4a9f474a-dc9d-475e-847d-0ea358045ed8, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:49:15.633197 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.633197 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.633553 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.634275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.634275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.634611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.634887 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.635218 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:15.640940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:15.664372 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:49:15.675704 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 4a9f474a-dc9d-475e-847d-0ea358045ed8) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:15.686597 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e38364e2-5f69-40b8-9998-ffc27826f07a None None] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:49:15.692391 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.699861 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:15.700486 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.720609 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.728893 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-798e10b6-7bf6-470b-88ff-224ffbc20eb3 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.8529923
Jun 01 18:49:15.731575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35366) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:15.736971 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:15.747183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:15.747183 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Usage tracker for resource:router and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:15.752003 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:15.769336 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:15.782641 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.783919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.799649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.804185 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2514dce9-35d9-4ba0-a964-f87a2864e94b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:15.814869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.816404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0beebc0-bf99-48b2-b9cc-f1f6e41d031c,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:15.824926 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:15.830542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:15.834854 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/e0beebc0-bf99-48b2-b9cc-f1f6e41d031c HTTP/1.1" status: 204  len: 168 time: 0.2239606
Jun 01 18:49:15.955015 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-4a9f474a-dc9d-475e-847d-0ea358045ed8', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:49:15.956793 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.125141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.180240 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Allocated IP 172.20.0.2 (4a9f474a-dc9d-475e-847d-0ea358045ed8/dead668a-1f23-483d-a130-8fd712cb633f/d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:16.342654 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-639d00c2-eeb4-4eea-88f4-80acd9463014 req-b46da0c6-5f14-497a-a5e1-9c735178a8a0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:16.347274 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-639d00c2-eeb4-4eea-88f4-80acd9463014 req-b46da0c6-5f14-497a-a5e1-9c735178a8a0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2169826
Jun 01 18:49:16.412118 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.423400 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Transition to ACTIVE for port object d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:16.427854 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-639d00c2-eeb4-4eea-88f4-80acd9463014 req-c4878cfe-dd72-407d-8cda-a9c404469d4e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0739832
Jun 01 18:49:16.443405 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Transition to ACTIVE for port object d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:16.459755 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.471217 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:16.542034 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:16.551796 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:16.556806 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:16.652284 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Pushing event updated for resources: {'Port': ['ID=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:16.671601 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.671906 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.672495 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.672984 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.673465 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.673982 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.674475 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.675528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.676050 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.676548 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.677102 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.677589 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:49:16.681757 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-45c611c0-12f9-4d4b-a1aa-a7377c068ea2 req-b261fd71-5e5e-4595-884e-bc4430c65bfe tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 210 time: 0.0615227
Jun 01 18:49:16.692460 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:16.698025 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.700722 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Attempting to bind port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:16.701206 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Attempting to bind port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:16.701587 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Attempting to bind port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 on network 4a9f474a-dc9d-475e-847d-0ea358045ed8 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:16.706223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-625d1979-41aa-4114-92e9-278fcebf6cf8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.711732 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 48, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:16.712122 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Checking segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:16.712575 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.712974 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Bound using segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:16.713452 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Bound port: d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:16.713838 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.736564 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.869392 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] For port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:16.875915 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] For port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:16.880205 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.885102 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:16.890419 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-99c5e7df-dd75-41c6-a018-c508c384daa8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:16.997083 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Pushing event updated for resources: {'Port': ['ID=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:17.000235 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:17.055376 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-4241cfdc-eba4-431c-bdb5-aac8c6e7b097 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:17.056106 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-4241cfdc-eba4-431c-bdb5-aac8c6e7b097 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Synchronizing usage tracker for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:17.085092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-4241cfdc-eba4-431c-bdb5-aac8c6e7b097 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Unset dirty status for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:17.085967 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-4241cfdc-eba4-431c-bdb5-aac8c6e7b097 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 809 time: 0.3609099
Jun 01 18:49:17.104474 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Allocated IP 172.27.0.188 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/dfeb3118-dc47-46a1-89e0-71ed3cdf9efd) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:17.151149 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-252bcc16-27cd-4a23-a702-cad06b7a7fed tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Synchronizing usage tracker for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:17.169386 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-252bcc16-27cd-4a23-a702-cad06b7a7fed tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Unset dirty status for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:17.170951 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-252bcc16-27cd-4a23-a702-cad06b7a7fed tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=85f17a1d02ae4454a980be1331cbe34d HTTP/1.1" status: 200  len: 380 time: 0.0715890
Jun 01 18:49:17.180862 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'port': {'device_id': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'admin_state_up': True, 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'security_groups': ['d9074e75-527a-4712-b152-f716718c4332']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:17.351346 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:17.382930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:17.391765 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:17.398384 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:17.399742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:17.413884 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Made reservation on behalf of 85f17a1d02ae4454a980be1331cbe34d for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:17.417843 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:17.477206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:17.480167 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:17.482878 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:17.519701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Pushing event updated for resources: {'Port': ['ID=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:17.522830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:17.621192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Allocated IP 172.20.0.5 (4fe37e11-4ddd-41fd-b2d4-95525adc3be2/e4405465-78ee-42fa-bf1d-3f535d074d0b/0721dbfe-8c91-42f7-b953-19fcbeb01603) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:17.794855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:17.863675 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35426) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:17.890154 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5aefe01-597d-4cd1-9d92-277b36ff1d50 req-e778007f-eb69-47b0-b420-18ad3f877957 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:17.891665 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d5aefe01-597d-4cd1-9d92-277b36ff1d50 req-e778007f-eb69-47b0-b420-18ad3f877957 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2979360
Jun 01 18:49:17.902650 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:17.960360 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb8b1a79-08c0-4eb5-bece-ebadb4afa9e7 req-ef4fc32b-60cb-4782-b0b0-8e39785553e7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 210 time: 0.0614552
Jun 01 18:49:17.984279 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Transition to ACTIVE for port object 0721dbfe-8c91-42f7-b953-19fcbeb01603 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:18.008781 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d5aefe01-597d-4cd1-9d92-277b36ff1d50 req-60238aa9-c9b1-4555-82a5-7fae851c20d9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1081240
Jun 01 18:49:18.045584 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.068664 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:18.078968 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:18.149884 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.177880 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:18.225086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:18.229661 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.238533 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:18.241059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:18.303151 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:18.317022 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Usage tracker for resource:security_group_rule and tenant:eebe7e7fb4aa4ae2be46aa45cab84610 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:18.322686 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:18.327625 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:18.335019 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:18.343021 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35cf4910-1839-440f-8004-e8751f27a190 None None] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:49:18.344953 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:18.352720 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:18.353353 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.411711 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2349260
Jun 01 18:49:18.428755 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Request body: {'port': {'device_id': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:18.476103 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Provisioning for port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:18.492365 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Provisioning complete for port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:18.492694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.564524 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.605081 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.610417 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.621275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.631651 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3c9dfdf5-ca1e-4ccd-a33c-067c16f6b056 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:18.708655 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=eebe7e7fb4aa4ae2be46aa45cab84610&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8406413
Jun 01 18:49:18.718225 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35434) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:18.725307 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.736623 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6e9d891-fde2-4c7c-bcbe-5e5a8913c8fc,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:18.747161 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:18.792017 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] For port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:18.811416 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.829557 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:18.891859 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Router dd23659b-80fb-4c76-accf-8fae6eeb1c47 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98258) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:49:18.899304 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:18.940914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Pushing event updated for resources: {'Port': ['ID=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:18.943952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-4993952b-b6de-4fe8-894e-f18d2eab8bf9 None None] Provisioning for port 0721dbfe-8c91-42f7-b953-19fcbeb01603 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:18.951310 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:18.951903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-4993952b-b6de-4fe8-894e-f18d2eab8bf9 None None] Provisioning complete for port 0721dbfe-8c91-42f7-b953-19fcbeb01603 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:18.952291 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4993952b-b6de-4fe8-894e-f18d2eab8bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.012409 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-4993952b-b6de-4fe8-894e-f18d2eab8bf9 None None] Port 0721dbfe-8c91-42f7-b953-19fcbeb01603 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:19.022005 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.113879 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:49:19.118463 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.130214 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Sync routers for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:49:19.133055 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f7a95075-2b4a-4f0b-90e7-2067b596f0f8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:19.137204 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ef8bd5a2-93fd-4112-bca0-5c203a7893a4 None None] Provisioning complete for port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:19.137591 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ef8bd5a2-93fd-4112-bca0-5c203a7893a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.143228 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:19.144878 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce80c670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:19.229864 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.231081 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.4984951
Jun 01 18:49:19.232998 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6e9d891-fde2-4c7c-bcbe-5e5a8913c8fc,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:19.234555 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35444) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:19.243194 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:19.246652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.250032 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/a6e9d891-fde2-4c7c-bcbe-5e5a8913c8fc HTTP/1.1" status: 204  len: 168 time: 0.5277076
Jun 01 18:49:19.259010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0721dbfe-8c91-42f7-b953-19fcbeb01603 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:19.275392 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.294392 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Transition to ACTIVE for port object 0721dbfe-8c91-42f7-b953-19fcbeb01603 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:19.304124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.311888 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-90f2bc44-7592-492f-9e1b-9ad0316e9268 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:19.345907 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:19.366928 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d7b601-59ca-451a-a7b1-6795ff424751 req-0ad20b82-12d4-4d4f-8a26-d41c0cc6c633 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:19.367919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-07d7b601-59ca-451a-a7b1-6795ff424751 req-0ad20b82-12d4-4d4f-8a26-d41c0cc6c633 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Synchronizing usage tracker for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:19.510000 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.600370 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:19.603246 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.292s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:19.607619 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-07d7b601-59ca-451a-a7b1-6795ff424751 req-0ad20b82-12d4-4d4f-8a26-d41c0cc6c633 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Unset dirty status for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:19.615101 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-07d7b601-59ca-451a-a7b1-6795ff424751 req-0ad20b82-12d4-4d4f-8a26-d41c0cc6c633 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 931 time: 0.4913781
Jun 01 18:49:19.635554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Attempting to bind port 0721dbfe-8c91-42f7-b953-19fcbeb01603 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:19.635936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Attempting to bind port 0721dbfe-8c91-42f7-b953-19fcbeb01603 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:19.636213 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Attempting to bind port 0721dbfe-8c91-42f7-b953-19fcbeb01603 on network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:19.650860 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Port 0721dbfe-8c91-42f7-b953-19fcbeb01603 on network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:49:19.651206 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Attempting to bind port 0721dbfe-8c91-42f7-b953-19fcbeb01603 on network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:19.658420 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:19.658758 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Checking segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:19.659915 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Bound using segment: {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:19.660359 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Bound port: 0721dbfe-8c91-42f7-b953-19fcbeb01603, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '78789faf-e362-4dcb-9299-2450da3fd2ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 90, 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:19.660847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.695430 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce80c670>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:17Z', 'revision_number': 3, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:19.700395 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Checking router: dd23659b-80fb-4c76-accf-8fae6eeb1c47 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:49:19.700767 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Updating router dd23659b-80fb-4c76-accf-8fae6eeb1c47 port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:49:19.705380 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-07d7b601-59ca-451a-a7b1-6795ff424751 req-da5128dc-2664-46de-8b7c-8466a5fa1f6a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0893102
Jun 01 18:49:19.762154 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.844239 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:19.848389 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:19.856113 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.862208 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-daaa47fa-422c-4af9-ad95-3c41af586064 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:19.916141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60af7e8b-9647-4bb0-863b-a2d7c4005dc0 req-7bb63e18-326c-4a96-9ebc-4ccccef918c5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:19.928904 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-60af7e8b-9647-4bb0-863b-a2d7c4005dc0 req-7bb63e18-326c-4a96-9ebc-4ccccef918c5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.7813959
Jun 01 18:49:19.945966 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:19.946582 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:19.948947 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] 10.222.0.25 "PUT /v2.0/ports/0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 1093 time: 1.5267580
Jun 01 18:49:19.949352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:19.951808 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3" -d '{"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:20.045214 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:20.105471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:20.108375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:20.180581 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:20.181867 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.195790 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bfa589a7-0814-41e5-84fe-4407061b77bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:20.200855 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-bfa589a7-0814-41e5-84fe-4407061b77bd service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1096 time: 0.1970236
Jun 01 18:49:20.309553 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-60af7e8b-9647-4bb0-863b-a2d7c4005dc0 req-55203a09-be61-472f-8b3a-8f5bd4d91c65 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3735044
Jun 01 18:49:20.365286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-417eb532-a751-4039-8289-8e89047116c5 x-openstack-request-id: req-417eb532-a751-4039-8289-8e89047116c5 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:20.365606 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:20.365873 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-417eb532-a751-4039-8289-8e89047116c5 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:20.366374 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'status': 'completed', 'code': 200}
Jun 01 18:49:20.367854 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-8bf44f67-f785-4697-ad66-e9952f90891c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 217 time: 0.1583800
Jun 01 18:49:20.399589 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.419404 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Transition to ACTIVE for port object dfeb3118-dc47-46a1-89e0-71ed3cdf9efd will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:20.437019 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.449543 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-8a596aeb-6a87-4069-9d59-900e79cd778d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:20.482305 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3f62388f-8f5c-430f-b8df-f5efb2062d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:20.484121 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-3f62388f-8f5c-430f-b8df-f5efb2062d3b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.1094394
Jun 01 18:49:20.512925 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Attempting to bind port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:20.513538 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Attempting to bind port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:20.514096 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Attempting to bind port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:20.538925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.549793 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:20.550711 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:20.551305 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.551881 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:20.552711 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Bound port: dfeb3118-dc47-46a1-89e0-71ed3cdf9efd, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:20.553266 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.574697 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-70fabf20-acd2-48d3-87f4-3c68284d4aba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:20.576379 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-70fabf20-acd2-48d3-87f4-3c68284d4aba service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0840139
Jun 01 18:49:20.595573 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce013b5-349e-4e67-a9d2-01783ca111d0 None None] Pushing event updated for resources: {'Port': ['ID=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,revision_number=2']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:20.617085 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-7ce013b5-349e-4e67-a9d2-01783ca111d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:20.667300 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] For port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:20.670886 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] For port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:20.689692 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:20.700852 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:20.816416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Allocated IP 172.20.0.1 (4a9f474a-dc9d-475e-847d-0ea358045ed8/dead668a-1f23-483d-a130-8fd712cb633f/1a05b744-420f-4fd3-b1fa-f937ac69b420) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:20.849537 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce013b5-349e-4e67-a9d2-01783ca111d0 None None] Pushing event updated for resources: {'Port': ['ID=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:20.854217 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-d6a961b7-94ec-4a02-9b70-bd593f64896d service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2699707
Jun 01 18:49:20.858314 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-7ce013b5-349e-4e67-a9d2-01783ca111d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:20.908975 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:20.913157 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce80c670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:21.004651 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:21.021502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Transition to ACTIVE for port object 1a05b744-420f-4fd3-b1fa-f937ac69b420 will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:21.144848 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-42406ec1-e0a3-48c1-a105-7d27729bf922 req-d589702a-c084-4561-ae7d-b2fcae36f28e service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2823730
Jun 01 18:49:21.312397 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:21.313065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-4389dc45-efb5-491e-a6d4-9baa16da742f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:21.315078 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-4389dc45-efb5-491e-a6d4-9baa16da742f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1096 time: 0.1075916
Jun 01 18:49:21.322898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:21.343303 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:21.427466 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Pushing event updated for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:21.447867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:21.457225 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:21.468335 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:21.472465 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:21.496535 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-363caf2f-6eeb-491a-9157-8cd8b48fff28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:21.498654 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-363caf2f-6eeb-491a-9157-8cd8b48fff28 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.1764951
Jun 01 18:49:21.556409 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da58d5c3-8225-4939-822a-b9690095ff3e req-1f2c55c4-0cb6-4090-816a-8e9eddbd632f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:21.558375 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-da58d5c3-8225-4939-822a-b9690095ff3e req-1f2c55c4-0cb6-4090-816a-8e9eddbd632f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.5167706
Jun 01 18:49:21.590926 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:21.594074 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-ddbcec9e-0623-4e1f-87f0-b9b750bb6389 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 217 time: 0.0873418
Jun 01 18:49:21.668971 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-da58d5c3-8225-4939-822a-b9690095ff3e req-b825ffae-095f-46f9-a2e9-8fc8796def24 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1029387
Jun 01 18:49:21.692124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-8b8ca869-00cb-4910-a563-6fdee2cfa1e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:21.696863 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-8b8ca869-00cb-4910-a563-6fdee2cfa1e9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0927386
Jun 01 18:49:21.827474 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce80c670>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:17Z', 'revision_number': 3, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:21.833322 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d2fbc5-e055-41b0-adf4-6f25af3343a8 None None] The sync data for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi is: [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:17Z', 'revision_number': 3, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:49:21.853887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:21.916706 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-6c5a9ad2-f08b-4351-8298-eb76a430a04c None None] Provisioning for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:21.919687 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-1a6c4af1-26f7-45b6-b44e-4a88acbf213d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:21.921257 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-1a6c4af1-26f7-45b6-b44e-4a88acbf213d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2057505
Jun 01 18:49:21.925426 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-6c5a9ad2-f08b-4351-8298-eb76a430a04c None None] Provisioning complete for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:21.926076 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-6c5a9ad2-f08b-4351-8298-eb76a430a04c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:21.998933 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6790552-d772-4c2a-8867-011e63523615 req-b906478a-5afd-4dbb-9cf9-ce26ee9ee784 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:22.007100 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d6790552-d772-4c2a-8867-011e63523615 req-b906478a-5afd-4dbb-9cf9-ce26ee9ee784 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2026789
Jun 01 18:49:22.013605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-6c5a9ad2-f08b-4351-8298-eb76a430a04c None None] Port 1a05b744-420f-4fd3-b1fa-f937ac69b420 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:22.189464 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d6790552-d772-4c2a-8867-011e63523615 req-7d1fcf42-125a-4073-b56d-adfbc165d4e1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1808898
Jun 01 18:49:22.338766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:22.339637 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-b9863a1d-6a98-4562-b5b0-3d0d1b1718a5 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4050009
Jun 01 18:49:22.344114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:22.456406 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2e9f9ebb-ae9c-459b-a94b-afd585c2608c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:22.522970 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:22.598054 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6202e22e-74d1-4c25-8e4f-7b6f6b11f7f3 req-c7cf4f04-10d8-4ac7-9624-f8f28c9e2678 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2426310
Jun 01 18:49:22.669980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Pushing event updated for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:22.673466 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:22.724109 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:22.725267 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:23.013874 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Router dd23659b-80fb-4c76-accf-8fae6eeb1c47 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:49:23.151044 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-4136ecc0-52e5-4289-aea4-d2b4a8c75dbd None None] Provisioning complete for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:23.151550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4136ecc0-52e5-4289-aea4-d2b4a8c75dbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:23.233574 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-127a86d9-89a1-45d6-8ae2-25039b2fdc21 req-76c87fd9-0dfc-4288-a8bc-2eaba1bcdd59 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:23.241840 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-127a86d9-89a1-45d6-8ae2-25039b2fdc21 req-76c87fd9-0dfc-4288-a8bc-2eaba1bcdd59 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.1481168
Jun 01 18:49:23.273628 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:49:23.287179 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] 10.222.0.22 "PUT /v2.0/routers/dd23659b-80fb-4c76-accf-8fae6eeb1c47/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.0511544
Jun 01 18:49:23.319604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-4136ecc0-52e5-4289-aea4-d2b4a8c75dbd None None] Port 1a05b744-420f-4fd3-b1fa-f937ac69b420 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:23.355623 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-127a86d9-89a1-45d6-8ae2-25039b2fdc21 req-34b0e55a-3027-4c76-9b90-1d903887557b tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1123257
Jun 01 18:49:23.558532 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216722af-1bbd-40bb-9c34-df2965f78fe0 req-9bdb7128-1bf1-4c85-9f56-7ae7cc55c478 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:23.560287 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-216722af-1bbd-40bb-9c34-df2965f78fe0 req-9bdb7128-1bf1-4c85-9f56-7ae7cc55c478 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1591792
Jun 01 18:49:23.666320 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-216722af-1bbd-40bb-9c34-df2965f78fe0 req-1aec1f36-a582-4bf3-93a8-62445a5c2238 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0997605
Jun 01 18:49:24.002916 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device dfeb3118-dc47-46a1-89e0-71ed3cdf9efd up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:24.128908 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:24.133689 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:24.134521 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.137481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35572) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:24.145019 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1169787598-network', 'tenant_id': '742cd095d98847558adeaa435437024e'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:24.150553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:24.155756 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Usage tracker for resource:network and tenant:742cd095d98847558adeaa435437024e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:24.159840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:24.168949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:24.181107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Made reservation on behalf of 742cd095d98847558adeaa435437024e for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:24.185026 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.200483 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.224067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:24.230708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Usage tracker for resource:security_group_rule and tenant:742cd095d98847558adeaa435437024e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:24.234062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:24.240797 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:24.347368 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.372751 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:24.377333 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.384017 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:24.412083 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.417246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.422831 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-31f987ae-20bc-4783-9f66-52dcbf749201 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:24.439866 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1d4d8-17ab-431d-a522-289f151c96f4 req-2fa137a8-a1d3-49c8-8667-d936383c03be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:24.442531 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f4b1d4d8-17ab-431d-a522-289f151c96f4 req-2fa137a8-a1d3-49c8-8667-d936383c03be service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.1164367
Jun 01 18:49:24.461937 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Sync routers for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:49:24.490490 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] vlan segment allocate from pool success with {'vlan_id': 62, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:49:24.513547 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=540ab077-d726-47b4-9f8c-e2b384007bb4,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:24.530350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:24.536530 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.537079 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Added segment f8613a04-61a1-4be3-8e1e-105a7c0512c1 of type vlan for network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e
Jun 01 18:49:24.539654 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f4b1d4d8-17ab-431d-a522-289f151c96f4 req-dea54a4c-39f4-4d31-8055-ec195fceb466 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0872509
Jun 01 18:49:24.549540 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:24.550262 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbaac70>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:24.607674 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.635003 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:24.640520 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:24.656780 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.658779 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:24.659387 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.669324 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed2b535-2b57-4ced-b2e7-0af89db39a17 req-f2d590b7-98db-449b-85b6-378fbeaf4438 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:24.670762 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-eed2b535-2b57-4ced-b2e7-0af89db39a17 req-f2d590b7-98db-449b-85b6-378fbeaf4438 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.1225979
Jun 01 18:49:24.672787 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:24.752169 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.6131139
Jun 01 18:49:24.755608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 35584) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:24.760694 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Request body: {'subnet': {'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1169787598-subnet', 'tenant_id': '742cd095d98847558adeaa435437024e', 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:24.773567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:24.777958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Usage tracker for resource:subnet and tenant:742cd095d98847558adeaa435437024e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:24.781253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:24.789916 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:24.792113 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:24.845562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Made reservation on behalf of 742cd095d98847558adeaa435437024e for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:24.848192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3724192'] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:24.897841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Pushing event updated for resources: {'Network': ['ID=670539f1-1de1-4f09-80bf-a0edd1cf2a6e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:24.902407 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-eed2b535-2b57-4ced-b2e7-0af89db39a17 req-81dec547-5402-4866-a56e-58cb960f7bcc tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2101216
Jun 01 18:49:24.903176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:24.921516 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:49:24.973309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0f2146-2b2d-4167-a170-2b7cd3b71951 req-5229847a-0d34-4af1-b7b5-ba4641ea9ce8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:24.974709 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e0f2146-2b2d-4167-a170-2b7cd3b71951 req-5229847a-0d34-4af1-b7b5-ba4641ea9ce8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1875358
Jun 01 18:49:25.070679 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e0f2146-2b2d-4167-a170-2b7cd3b71951 req-bff5a5c2-6cf4-4719-8a4b-032d5d76d0e9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0860257
Jun 01 18:49:25.220604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbaac70>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 2, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:25.225220 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Checking router: dd23659b-80fb-4c76-accf-8fae6eeb1c47 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:49:25.226229 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Updating router dd23659b-80fb-4c76-accf-8fae6eeb1c47 port 1a05b744-420f-4fd3-b1fa-f937ac69b420 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:49:25.292903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.451226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2209766', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3724178'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.456632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-82b20465-7c50-47eb-91cd-2c8a426a8b15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:25.554260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-8e27a343-f070-4cd5-98b8-d1d219fdd0b7 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:25.556166 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-8e27a343-f070-4cd5-98b8-d1d219fdd0b7 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.2069261
Jun 01 18:49:25.587875 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-9a535926-9e7e-43c5-a884-fe5500cc476b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/quotas/ab05a0b11f6c4dc5b84c7c8e30bafa9d HTTP/1.1" status: 200  len: 375 time: 0.0253346
Jun 01 18:49:25.615855 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2051909f-1c03-4f79-b469-2b5fd38c2cd4,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:25.619440 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:25.680299 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Checking segment: {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:25.680904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Network hostable DHCP agents. Network: 670539f1-1de1-4f09-80bf-a0edd1cf2a6e, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:49:25.701765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:49:25.717418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 670539f1-1de1-4f09-80bf-a0edd1cf2a6e) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:25.732286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:25.733148 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.736084 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-1f2bcf03-d002-4a00-8b63-f14ff2496d1e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1453183
Jun 01 18:49:25.741429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53dd7f90-3892-4c2c-8c36-e3bac0a9fd47 None None] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:49:25.777381 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35614) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:25.778141 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.0211942
Jun 01 18:49:25.787070 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:25.798485 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:25.817435 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Usage tracker for resource:router and tenant:742cd095d98847558adeaa435437024e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:25.821883 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:25.848087 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.871406 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:25.871926 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Transition to ACTIVE for port object 1a05b744-420f-4fd3-b1fa-f937ac69b420 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:25.891378 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.892338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.903748 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:25.914297 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:25.968571 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-e8d8071a-e988-42d1-bf5b-d4842f48b353 service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2215800
Jun 01 18:49:26.012326 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device dfeb3118-dc47-46a1-89e0-71ed3cdf9efd up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:26.132803 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.147513 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Pushing event updated for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:26.161887 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:26.166899 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-5bce3a7a-dbfb-4616-b9f1-e396a495a6e4 service neutron] 10.222.0.22 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1971767
Jun 01 18:49:26.335024 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Attempting to bind port 1a05b744-420f-4fd3-b1fa-f937ac69b420 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:26.335403 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Attempting to bind port 1a05b744-420f-4fd3-b1fa-f937ac69b420 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:26.335828 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Attempting to bind port 1a05b744-420f-4fd3-b1fa-f937ac69b420 on network 4a9f474a-dc9d-475e-847d-0ea358045ed8 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:26.338134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:26.338514 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.366431 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554b2e9b-d52b-45c3-865a-e952b052f01f req-e6814b33-7cdc-49bb-abc2-d5ce6676798d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:26.369477 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-554b2e9b-d52b-45c3-865a-e952b052f01f req-e6814b33-7cdc-49bb-abc2-d5ce6676798d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.1623750
Jun 01 18:49:26.371409 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'tenant_id': '742cd095d98847558adeaa435437024e', 'fixed_ips': [{'subnet_id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:49:26.372247 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.399207 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:26.399559 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Checking segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:26.399970 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.400372 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Bound using segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:26.400888 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Bound port: 1a05b744-420f-4fd3-b1fa-f937ac69b420, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:26.401268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.455481 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-554b2e9b-d52b-45c3-865a-e952b052f01f req-2abddcb7-55be-4463-af7d-37663acdc987 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0791013
Jun 01 18:49:26.542422 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.697190 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0682e8-58c0-420f-9da0-49cbbb0a24cb req-cf89ec65-2844-4c9b-892f-595f1d98fcde tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:26.709371 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e0682e8-58c0-420f-9da0-49cbbb0a24cb req-cf89ec65-2844-4c9b-892f-595f1d98fcde tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1513631
Jun 01 18:49:26.731881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] For port 1a05b744-420f-4fd3-b1fa-f937ac69b420, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:26.762796 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842661f2-f517-4203-8c5b-5ffda0486e9a req-113d43a9-c6e3-40a4-b73b-c0a39801967d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:26.772736 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-842661f2-f517-4203-8c5b-5ffda0486e9a req-113d43a9-c6e3-40a4-b73b-c0a39801967d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.3215861
Jun 01 18:49:26.816623 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e0682e8-58c0-420f-9da0-49cbbb0a24cb req-22737164-cdce-4f5a-8d15-eb378261d852 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0992222
Jun 01 18:49:26.817459 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] For port 1a05b744-420f-4fd3-b1fa-f937ac69b420, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=1a05b744-420f-4fd3-b1fa-f937ac69b420,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:26.830566 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:26.839200 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Allocated IP 172.20.0.2 (670539f1-1de1-4f09-80bf-a0edd1cf2a6e/2051909f-1c03-4f79-b469-2b5fd38c2cd4/ef79ecbf-493f-47d9-8366-f7e25ab3bdfa) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:26.842226 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:26.865910 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-842661f2-f517-4203-8c5b-5ffda0486e9a req-24c9766c-2291-4fbd-9e9b-d9ad338ff473 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0921855
Jun 01 18:49:27.012945 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e3aa21ae-190d-4ed4-b8dd-efd7280112e1 req-43d6a748-8d37-422b-a88d-9bb2a08c8d41 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 210 time: 0.0606079
Jun 01 18:49:27.055358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:27.056117 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbaac70>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:27.111571 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Pushing event updated for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:27.145881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:27.213857 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.229883 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:49:27.274631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.439636 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-b2a14018-6b9b-44c4-923e-feba88bd725e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:27.441605 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-b2a14018-6b9b-44c4-923e-feba88bd725e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.1090672
Jun 01 18:49:27.449127 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:27.587119 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-62965800-7a0d-44d2-93a8-89edeb6cb361 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:27.589387 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-62965800-7a0d-44d2-93a8-89edeb6cb361 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.1384039
Jun 01 18:49:27.616832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Allocated IP 172.27.0.178 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/8b8474fc-cdc4-4213-9f90-4b017b63dded) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:27.635975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12da89a-9497-4b52-9711-033426d3fd0c req-e0a4c0cf-63b2-4319-8e17-b306e664453f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:27.637758 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b12da89a-9497-4b52-9711-033426d3fd0c req-e0a4c0cf-63b2-4319-8e17-b306e664453f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1741014
Jun 01 18:49:27.645784 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.707272 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Transition to ACTIVE for port object ef79ecbf-493f-47d9-8366-f7e25ab3bdfa will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:27.724977 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-4a2b58ee-1368-49ec-8ed7-ecee72c5e7a6 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.0808644
Jun 01 18:49:27.779433 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b12da89a-9497-4b52-9711-033426d3fd0c req-f0014627-400d-45b7-b027-f83c19f8f7f7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1229794
Jun 01 18:49:27.808559 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-9f89d1e8-3921-4bb6-b8a8-b06923af0b2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:27.810341 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-9f89d1e8-3921-4bb6-b8a8-b06923af0b2f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0724130
Jun 01 18:49:27.814104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Transition to ACTIVE for port object ef79ecbf-493f-47d9-8366-f7e25ab3bdfa will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:27.819006 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8d1beb-c51d-4a67-9838-ed94ef717bcd req-e9c8c96d-77d9-4faf-8f7f-b97fd5a8c50e tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:27.825368 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fb8d1beb-c51d-4a67-9838-ed94ef717bcd req-e9c8c96d-77d9-4faf-8f7f-b97fd5a8c50e tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.2348695
Jun 01 18:49:27.835664 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.838918 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.848127 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-43e7a37d-51aa-4ff9-8c26-4489664312ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:27.872758 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:27.877888 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:27.929105 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:27.938631 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:27.975773 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:27.995844 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Pushing event updated for resources: {'Port': ['ID=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:28.021720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:28.025187 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:28.032968 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:28.036683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:28.083015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Pushing event updated for resources: {'Port': ['ID=8b8474fc-cdc4-4213-9f90-4b017b63dded,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:28.122670 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Attempting to bind port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:28.123205 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Attempting to bind port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:28.123446 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Attempting to bind port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa on network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:28.125013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:28.131538 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:28.131922 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Checking segment: {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:28.133728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:28.134152 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Bound using segment: {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:28.134619 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Bound port: ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:28.134997 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:28.184419 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fb8d1beb-c51d-4a67-9838-ed94ef717bcd req-1c0d2b29-7a13-480d-894d-ec1f7aa0507f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3180478
Jun 01 18:49:28.197384 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-22ed59ae-00c1-48da-9621-3b383ba1576b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.3710327
Jun 01 18:49:28.208488 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbaac70>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:26Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:28.226719 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211ff91e-29ce-4864-a0ea-1f9b12413e7f None None] The sync data for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi is: [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:26Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:49:28.259044 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] For port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:28.263302 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] For port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:28.272061 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:28.279490 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:28.412910 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f28d4e8-a1b4-4bc2-bbf9-e5a3a9f7c3b9 req-4646d80b-321e-4389-8acc-32734bf6a539 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:28.414468 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4f28d4e8-a1b4-4bc2-bbf9-e5a3a9f7c3b9 req-4646d80b-321e-4389-8acc-32734bf6a539 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.3363428
Jun 01 18:49:28.426274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7cdcc4b5-c6ce-4aa5-ae8d-7a2bec74b955 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:28.430267 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7cdcc4b5-c6ce-4aa5-ae8d-7a2bec74b955 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/networks?id=2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 200  len: 815 time: 0.4817698
Jun 01 18:49:28.456545 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Pushing event updated for resources: {'Port': ['ID=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:28.461067 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:28.522925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Request body: {'port': {'device_id': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'admin_state_up': True, 'tenant_id': 'ab05a0b11f6c4dc5b84c7c8e30bafa9d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:28.579702 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4f28d4e8-a1b4-4bc2-bbf9-e5a3a9f7c3b9 req-f13188a6-5b61-4e72-b241-e4f6934b7fef tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1565568
Jun 01 18:49:28.664111 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a3195366-e87d-4ac0-a056-ac2f9bf89042 req-8c18eaf0-45b1-490c-9b21-d6486e1bbc3f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 210 time: 0.2876058
Jun 01 18:49:28.731064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:28.735103 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:28.773352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:28.783126 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-d3f67c5a-4773-42a9-b770-aff03b26c1ba service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5557830
Jun 01 18:49:28.818206 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Made reservation on behalf of ab05a0b11f6c4dc5b84c7c8e30bafa9d for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:28.825992 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:29.084590 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0ae7d6dd-a763-4f49-a2c3-72bef9e46fa3 req-b2175a40-82fd-4740-be5a-fa2575e54ce4 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2923830
Jun 01 18:49:29.307347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Allocated IP 172.20.0.10 (2bc7607a-0e83-4423-b9b7-ac3e13607a13/b40008fb-ef5f-4ddd-be90-93c9dd2d5423/69b10932-a965-4259-8f8c-39d6322653b1) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:29.342427 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1251f5a-18a0-4ff3-a879-d80debee7298 req-7fcd51de-265f-4dd1-8f71-c4fba006ac49 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:29.343923 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f1251f5a-18a0-4ff3-a879-d80debee7298 req-7fcd51de-265f-4dd1-8f71-c4fba006ac49 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.3123739
Jun 01 18:49:29.520166 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:29.566476 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd042ffc-3d77-4b6d-9682-83522262d832 req-87bd3e5f-f7a3-4074-99af-7652f5aa1566 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:29.573980 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cd042ffc-3d77-4b6d-9682-83522262d832 req-87bd3e5f-f7a3-4074-99af-7652f5aa1566 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.2556660
Jun 01 18:49:29.588075 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f1251f5a-18a0-4ff3-a879-d80debee7298 req-91e8ca68-6dbb-4560-81ce-ffb3d6953685 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1098790
Jun 01 18:49:29.684517 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cd042ffc-3d77-4b6d-9682-83522262d832 req-9ab4715b-032d-4626-90ed-5f1f7bbaa927 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1093986
Jun 01 18:49:29.716024 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:29.772256 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:29.780027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:29.785799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256', '00a066ed-ad86-4d31-9083-bf2f681a2c2c', '4878da57-0d45-4191-82df-acc476090da6'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:29.909765 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9c08089-2afd-41d5-a27a-97a5390576c3 None None] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:49:29.937798 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Router 1b85b9f8-dc37-4e55-a487-327bd03cc314 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98258) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:49:29.939624 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event updated for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:29.944320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:29.945329 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:29.948161 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:29.950929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:30.042119 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:30.042729 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.064451 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9d57b2-3242-421c-b423-c4ef5dbf59f0 req-0960e197-81c1-4361-a038-cea6346085d3 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:30.065720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb6c426-ac73-4f7c-b7ce-04f84eef4024 req-18bdfc51-6235-4675-a7a4-06cbc41449e9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:30.067276 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ccb6c426-ac73-4f7c-b7ce-04f84eef4024 req-18bdfc51-6235-4675-a7a4-06cbc41449e9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.2618821
Jun 01 18:49:30.068411 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-aa9d57b2-3242-421c-b423-c4ef5dbf59f0 req-0960e197-81c1-4361-a038-cea6346085d3 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 932 time: 0.2157247
Jun 01 18:49:30.122266 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-9069756b-bf3b-4324-8e3d-4f1c31285937 None None] Provisioning for port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:30.127686 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-aa9d57b2-3242-421c-b423-c4ef5dbf59f0 req-e8c5a471-0785-408e-b355-7c19dde7819a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0582600
Jun 01 18:49:30.129732 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.6114202
Jun 01 18:49:30.148574 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Request body: {'port': {'device_id': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:30.188536 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device ef79ecbf-493f-47d9-8366-f7e25ab3bdfa up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:30.282713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.285261 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ccb6c426-ac73-4f7c-b7ce-04f84eef4024 req-3d732cef-af1c-496a-8f49-dd98ca4dca61 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1456137
Jun 01 18:49:30.286378 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:49:30.295181 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Sync routers for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:49:30.311665 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:30.317268 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cddbc7c0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:30.338791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.343067 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 4.5642498
Jun 01 18:49:30.344257 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35692) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:30.400904 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:30.414915 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:30.415300 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.653851 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:30.799172 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.924280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:30.936550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:30.936550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1a05b744-420f-4fd3-b1fa-f937ac69b420 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:30.966707 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:30.980160 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 69b10932-a965-4259-8f8c-39d6322653b1 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:31.049049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.129958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Transition to ACTIVE for port object 69b10932-a965-4259-8f8c-39d6322653b1 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:31.134612 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:31.140780 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:31.155175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:31.159479 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823e388b-cd6b-4f7f-a860-20b88bd63504 req-5e929d42-3e02-4d60-a714-83c4f21a9ec6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:31.169514 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:31.169903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.170747 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-823e388b-cd6b-4f7f-a860-20b88bd63504 req-5e929d42-3e02-4d60-a714-83c4f21a9ec6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.3376429
Jun 01 18:49:31.174951 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cddbc7c0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:28Z', 'revision_number': 3, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:31.179663 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Checking router: 1b85b9f8-dc37-4e55-a487-327bd03cc314 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:49:31.180026 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Updating router 1b85b9f8-dc37-4e55-a487-327bd03cc314 port 8b8474fc-cdc4-4213-9f90-4b017b63dded binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:49:31.193288 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.202156 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:31.237159 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:49:31.303509 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-540ada7b-fa09-428b-83a1-d3fed9f5e93e None None] Provisioning complete for port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:31.303900 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-540ada7b-fa09-428b-83a1-d3fed9f5e93e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.332956 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.466038 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-823e388b-cd6b-4f7f-a860-20b88bd63504 req-ebaac602-484c-4237-a57b-b9cb31e0c84c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2943277
Jun 01 18:49:31.560455 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae97b2d-1ac1-4329-8349-2d7d3dc12d86 req-f2ce3b08-5ca3-4e26-928f-9c52ab7fa564 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:31.567320 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ae97b2d-1ac1-4329-8349-2d7d3dc12d86 req-f2ce3b08-5ca3-4e26-928f-9c52ab7fa564 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.5801916
Jun 01 18:49:31.633454 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Pushing event updated for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:31.651248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.449s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:31.738242 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:31.745891 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ae97b2d-1ac1-4329-8349-2d7d3dc12d86 req-153c690b-a28a-4f1c-ab40-2e526abbe9ae tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1685834
Jun 01 18:49:31.794955 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'mac_address': 'fa:16:3e:84:e4:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 90, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:49:31.872398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.925875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Attempting to bind port 69b10932-a965-4259-8f8c-39d6322653b1 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:31.926255 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Attempting to bind port 69b10932-a965-4259-8f8c-39d6322653b1 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:31.926959 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Attempting to bind port 69b10932-a965-4259-8f8c-39d6322653b1 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:31.927179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.932713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Port 69b10932-a965-4259-8f8c-39d6322653b1 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:49:31.933044 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Attempting to bind port 69b10932-a965-4259-8f8c-39d6322653b1 on network 2bc7607a-0e83-4423-b9b7-ac3e13607a13 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:31.938475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:31.938818 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Checking segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:31.939202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Bound using segment: {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:31.939631 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Bound port: 69b10932-a965-4259-8f8c-39d6322653b1, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8aee0e97-a508-4a4c-9292-a97cd5317182', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 92, 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:31.939980 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.960203 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:31.987643 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0721dbfe-8c91-42f7-b953-19fcbeb01603 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:31.992694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 1a05b744-420f-4fd3-b1fa-f937ac69b420, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=1a05b744-420f-4fd3-b1fa-f937ac69b420,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:32.003608 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.007510 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.048488 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.060826 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Transition to ACTIVE for port object 8b8474fc-cdc4-4213-9f90-4b017b63dded will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:32.071538 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.073484 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:32.081845 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.084645 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.095511 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.110042 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:32.113629 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:32.115231 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.026s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.115358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=69b10932-a965-4259-8f8c-39d6322653b1,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:32.126764 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e903d60f-d6f9-4f53-a084-e573b1ecb0e7 req-2e684dec-a1ea-4f32-a69a-c4f5d74a5d17 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:32.127547 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-e903d60f-d6f9-4f53-a084-e573b1ecb0e7 req-2e684dec-a1ea-4f32-a69a-c4f5d74a5d17 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:32.132585 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.139291 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.156954 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device ef79ecbf-493f-47d9-8366-f7e25ab3bdfa up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:32.178510 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Attempting to bind port 8b8474fc-cdc4-4213-9f90-4b017b63dded on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:32.178885 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Attempting to bind port 8b8474fc-cdc4-4213-9f90-4b017b63dded by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:32.179252 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Attempting to bind port 8b8474fc-cdc4-4213-9f90-4b017b63dded on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:32.189164 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:32.189933 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:32.189933 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.190359 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:32.190833 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Bound port: 8b8474fc-cdc4-4213-9f90-4b017b63dded, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:32.191207 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.214252 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-e903d60f-d6f9-4f53-a084-e573b1ecb0e7 req-2e684dec-a1ea-4f32-a69a-c4f5d74a5d17 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:32.215718 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e903d60f-d6f9-4f53-a084-e573b1ecb0e7 req-2e684dec-a1ea-4f32-a69a-c4f5d74a5d17 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.3634140
Jun 01 18:49:32.223188 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c43c3684-f36a-4055-a413-b4cea4832a23 None None] Pushing event updated for resources: {'Port': ['ID=8b8474fc-cdc4-4213-9f90-4b017b63dded,revision_number=2']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.230602 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-c43c3684-f36a-4055-a413-b4cea4832a23 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:32.244812 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:32.245469 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.246987 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] 10.222.0.25 "PUT /v2.0/ports/69b10932-a965-4259-8f8c-39d6322653b1 HTTP/1.1" status: 200  len: 1094 time: 2.1063170
Jun 01 18:49:32.249324 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:32.251649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1309467b-dee2-4027-b9c1-a4fbca6a406e" -d '{"events": [{"name": "network-changed", "server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "tag": "69b10932-a965-4259-8f8c-39d6322653b1"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:32.278056 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:32.278685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.287616 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] For port 8b8474fc-cdc4-4213-9f90-4b017b63dded, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:32.288203 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e799b25-8d1e-40e3-b6d7-aa9ad8f225fc req-67f9c7a7-8823-4d8f-9e30-ca393dfaff5e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:32.291957 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] For port 8b8474fc-cdc4-4213-9f90-4b017b63dded, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8b8474fc-cdc4-4213-9f90-4b017b63dded,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:32.293225 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e903d60f-d6f9-4f53-a084-e573b1ecb0e7 req-4255590d-cfd8-4c68-b05b-dc5ce5c83789 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0657055
Jun 01 18:49:32.297834 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.300004 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Pushing event updated for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.303432 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9e799b25-8d1e-40e3-b6d7-aa9ad8f225fc req-67f9c7a7-8823-4d8f-9e30-ca393dfaff5e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.3996663
Jun 01 18:49:32.307058 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:32.315904 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.328703 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.331880 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:32.411569 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:32.413163 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cddbc7c0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:32.414950 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9e799b25-8d1e-40e3-b6d7-aa9ad8f225fc req-45d7d72a-1fcb-4c81-8ae5-bc53ccec2bba tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1057093
Jun 01 18:49:32.437330 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Allocated IP 172.20.0.1 (670539f1-1de1-4f09-80bf-a0edd1cf2a6e/2051909f-1c03-4f79-b469-2b5fd38c2cd4/4253cb22-c78c-4cb6-8246-3860c05dfd90) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:32.485054 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f3787a0-d5fd-4c49-804d-5c7dbdf22a28 x-openstack-request-id: req-9f3787a0-d5fd-4c49-804d-5c7dbdf22a28 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:32.485375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "tag": "69b10932-a965-4259-8f8c-39d6322653b1", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:32.485649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-9f3787a0-d5fd-4c49-804d-5c7dbdf22a28 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:32.486112 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1', 'status': 'completed', 'code': 200}
Jun 01 18:49:32.543278 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c43c3684-f36a-4055-a413-b4cea4832a23 None None] Pushing event updated for resources: {'Port': ['ID=8b8474fc-cdc4-4213-9f90-4b017b63dded,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.554895 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-c43c3684-f36a-4055-a413-b4cea4832a23 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:32.603938 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.667792 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Transition to ACTIVE for port object 4253cb22-c78c-4cb6-8246-3860c05dfd90 will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:32.692723 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:32.696399 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4462ad-8adb-4281-a82b-fe452c65b218 req-04426da1-542f-44e2-a365-844b0846cb7f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:32.697957 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4e4462ad-8adb-4281-a82b-fe452c65b218 req-04426da1-542f-44e2-a365-844b0846cb7f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0934148
Jun 01 18:49:32.720602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf935ce-1cfa-4922-9851-56a9f7281905 req-4b363271-d9e9-4155-820f-b93fe2efb3ef tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:32.722628 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-daf935ce-1cfa-4922-9851-56a9f7281905 req-4b363271-d9e9-4155-820f-b93fe2efb3ef tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1089184
Jun 01 18:49:32.724039 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.728679 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:32.748460 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4e4462ad-8adb-4281-a82b-fe452c65b218 req-cd21e908-b5fc-4a30-be53-629e10a08491 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415738
Jun 01 18:49:32.804215 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:32.808833 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:32.820930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:32.893020 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:32.933611 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-daf935ce-1cfa-4922-9851-56a9f7281905 req-72326f12-2587-4796-b7bd-f37b8baf5f43 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1601799
Jun 01 18:49:32.935453 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Pushing event updated for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:32.938831 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:33.049074 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31aa1e4-58d4-45f7-8504-d12795b2f263 req-e9185ac0-f992-4ef0-aad5-ec9c75f281b2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:33.051271 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e31aa1e4-58d4-45f7-8504-d12795b2f263 req-e9185ac0-f992-4ef0-aad5-ec9c75f281b2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.1679680
Jun 01 18:49:33.077016 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cddbc7c0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:28Z', 'revision_number': 3, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:33.081652 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8143069f-5aad-4b0e-adcb-f33577b17718 None None] The sync data for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi is: [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:28Z', 'revision_number': 3, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:49:33.089649 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-dc5393e6-7dc6-4bec-bbaa-7f8c26a3e9e0 None None] Provisioning for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:33.097339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-dc5393e6-7dc6-4bec-bbaa-7f8c26a3e9e0 None None] Provisioning complete for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:33.097852 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-dc5393e6-7dc6-4bec-bbaa-7f8c26a3e9e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:33.127163 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e31aa1e4-58d4-45f7-8504-d12795b2f263 req-7727d562-cd6a-4380-b116-c85503af4f31 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0700428
Jun 01 18:49:33.128671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:33.178674 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-dc5393e6-7dc6-4bec-bbaa-7f8c26a3e9e0 None None] Port 4253cb22-c78c-4cb6-8246-3860c05dfd90 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:33.401766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:33.407752 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:33.448398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:33.619693 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:33.625139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Pushing event updated for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:33.632713 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:33.640486 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f157607-f1fe-4578-89af-62db2e813739 req-920dc8bf-1599-4785-94cc-461e94446565 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:33.642140 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0f157607-f1fe-4578-89af-62db2e813739 req-920dc8bf-1599-4785-94cc-461e94446565 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0861185
Jun 01 18:49:33.698367 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0f157607-f1fe-4578-89af-62db2e813739 req-0a989631-49d8-42e5-8b47-fa9d705522b1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0482883
Jun 01 18:49:33.731959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fdcafbc-f5e9-463b-b1e2-cbff86ab206c req-8f560505-d5b4-4c3b-9dd3-3d5043925957 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:33.733490 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7fdcafbc-f5e9-463b-b1e2-cbff86ab206c req-8f560505-d5b4-4c3b-9dd3-3d5043925957 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.2155788
Jun 01 18:49:33.818335 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7fdcafbc-f5e9-463b-b1e2-cbff86ab206c req-feacc77f-a339-4556-9569-670edb6b962a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0770199
Jun 01 18:49:33.824461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:33.825670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:34.045783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17571921-946a-49fd-9069-af06218bd364 req-9313fe52-723d-47fc-90c8-56f17768a84e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:34.047383 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-17571921-946a-49fd-9069-af06218bd364 req-9313fe52-723d-47fc-90c8-56f17768a84e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1305211
Jun 01 18:49:34.059222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Router 1b85b9f8-dc37-4e55-a487-327bd03cc314 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:49:34.109127 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-17571921-946a-49fd-9069-af06218bd364 req-3f81f402-21d2-41e2-a219-7ceb2e687d57 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0547411
Jun 01 18:49:34.129148 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-e639af36-a882-4623-b2d8-fb8ae76eb7ab None None] Provisioning complete for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:34.130938 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e639af36-a882-4623-b2d8-fb8ae76eb7ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:34.226423 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1a05b744-420f-4fd3-b1fa-f937ac69b420 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:34.295599 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-e639af36-a882-4623-b2d8-fb8ae76eb7ab None None] Port 4253cb22-c78c-4cb6-8246-3860c05dfd90 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:34.313187 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 1a05b744-420f-4fd3-b1fa-f937ac69b420 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:34.313669 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:34.385510 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:49:34.399245 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] 10.222.0.22 "PUT /v2.0/routers/1b85b9f8-dc37-4e55-a487-327bd03cc314/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.0538034
Jun 01 18:49:34.416320 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4009f9-4412-4cc2-8693-370cf749db03 req-a76ec998-b277-4e58-b3dd-33599c174e23 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:34.417848 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bd4009f9-4412-4cc2-8693-370cf749db03 req-a76ec998-b277-4e58-b3dd-33599c174e23 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.1197181
Jun 01 18:49:34.446850 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8b8474fc-cdc4-4213-9f90-4b017b63dded up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:34.468643 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bd4009f9-4412-4cc2-8693-370cf749db03 req-e0ff5ef8-fd91-4642-abf9-9d78cbfed982 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428126
Jun 01 18:49:34.524487 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 8b8474fc-cdc4-4213-9f90-4b017b63dded completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:34.529213 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 8b8474fc-cdc4-4213-9f90-4b017b63dded triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:34.529660 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:34.660139 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:34.677821 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 8b8474fc-cdc4-4213-9f90-4b017b63dded, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8b8474fc-cdc4-4213-9f90-4b017b63dded,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:34.682863 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:34.684732 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b805c96a-4fb1-44dd-a891-5fa328f0baf5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:34.762476 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=8b8474fc-cdc4-4213-9f90-4b017b63dded,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:34.771200 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:34.922346 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7a0354-3638-4634-93db-4265dc453946 req-62b70d9a-fca0-4668-9759-3029260be23a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:34.924501 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f7a0354-3638-4634-93db-4265dc453946 req-62b70d9a-fca0-4668-9759-3029260be23a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0965626
Jun 01 18:49:34.992112 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f7a0354-3638-4634-93db-4265dc453946 req-5e8a7a08-aee4-41e8-b7ce-80b60f76bbd4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0601699
Jun 01 18:49:35.022338 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Sync routers for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:49:35.058879 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:35.059511 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce0816a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:35.063015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc1f5c2-0e28-4821-882a-4a48d56e43da req-9b99ef63-d7a4-499d-8fd6-d514bbeef047 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.071377 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7dc1f5c2-0e28-4821-882a-4a48d56e43da req-9b99ef63-d7a4-499d-8fd6-d514bbeef047 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.1344178
Jun 01 18:49:35.128878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-2be8c450-8d7c-4747-b343-3ecbf9f74021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.131641 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-2be8c450-8d7c-4747-b343-3ecbf9f74021 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 1097 time: 0.1061118
Jun 01 18:49:35.175375 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7dc1f5c2-0e28-4821-882a-4a48d56e43da req-49992405-2215-4b0b-8527-bbc6c14ce1ba tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1023822
Jun 01 18:49:35.266715 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:35.386226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-4806cad4-c2a7-4f8b-afc5-67f7c8d3fd45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.387760 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-4806cad4-c2a7-4f8b-afc5-67f7c8d3fd45 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&shared=False HTTP/1.1" status: 200  len: 915 time: 0.2339540
Jun 01 18:49:35.400718 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['0721dbfe-8c91-42f7-b953-19fcbeb01603'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:35.551331 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-b67bfcd4-67ad-4e61-a98e-d968a1518d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.552826 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1309467b-dee2-4027-b9c1-a4fbca6a406e req-b67bfcd4-67ad-4e61-a98e-d968a1518d96 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 869 time: 0.1505995
Jun 01 18:49:35.583847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30b8ef5-8ea8-4330-beb3-7dee94696a14 req-a0e9334a-b8a6-401e-80f7-5c3d73ae9218 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.585378 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a30b8ef5-8ea8-4330-beb3-7dee94696a14 req-a0e9334a-b8a6-401e-80f7-5c3d73ae9218 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.2786121
Jun 01 18:49:35.784606 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a30b8ef5-8ea8-4330-beb3-7dee94696a14 req-57f477e3-7089-42ae-b8d4-61b56dbda544 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1893690
Jun 01 18:49:35.807590 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-c5b46537-dc09-4b4b-a296-98e572883db0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.809405 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-c5b46537-dc09-4b4b-a296-98e572883db0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 1097 time: 0.2000823
Jun 01 18:49:35.874367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3bb638e-6ed4-432b-aee9-2d791f27b7ea req-f5175757-0455-49ea-91df-1508d20e5643 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:35.876863 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a3bb638e-6ed4-432b-aee9-2d791f27b7ea req-f5175757-0455-49ea-91df-1508d20e5643 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.1944735
Jun 01 18:49:35.914385 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce0816a0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:33Z', 'revision_number': 4, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '4253cb22-c78c-4cb6-8246-3860c05dfd90', 'name': '', 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'tenant_id': '742cd095d98847558adeaa435437024e', 'mac_address': 'fa:16:3e:91:86:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:32Z', 'updated_at': '2021-06-01T18:49:33Z', 'revision_number': 2, 'project_id': '742cd095d98847558adeaa435437024e', 'subnets': [{'id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:35.919318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Checking router: 1b85b9f8-dc37-4e55-a487-327bd03cc314 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:49:35.919692 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Updating router 1b85b9f8-dc37-4e55-a487-327bd03cc314 port 4253cb22-c78c-4cb6-8246-3860c05dfd90 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:49:35.947775 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-5a3d8e7a-6354-47d5-a634-89f141b2d920 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=69b10932-a965-4259-8f8c-39d6322653b1 HTTP/1.1" status: 200  len: 217 time: 0.1287155
Jun 01 18:49:35.949250 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a3bb638e-6ed4-432b-aee9-2d791f27b7ea req-39267d05-e555-418c-a80b-5ae62d719271 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0658469
Jun 01 18:49:36.040456 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:36.099419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-075bf6e4-9f64-4254-9f1f-9ccf55d9930f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:36.101078 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-075bf6e4-9f64-4254-9f1f-9ccf55d9930f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 200  len: 855 time: 0.1454210
Jun 01 18:49:36.160004 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8b8474fc-cdc4-4213-9f90-4b017b63dded up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:36.220884 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-a21209a0-415e-4ba3-b072-d075bc84d43e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2bc7607a-0e83-4423-b9b7-ac3e13607a13&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1090529
Jun 01 18:49:36.238261 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-076ee8da-1e2e-486e-8330-2c1856f17abe req-697d4244-7ac7-4b92-a0f0-84e2a5fd811e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:36.251542 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-076ee8da-1e2e-486e-8330-2c1856f17abe req-697d4244-7ac7-4b92-a0f0-84e2a5fd811e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2486415
Jun 01 18:49:36.325523 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0d5b4f-de36-4793-a28f-7664eeae7d21 req-2c6a6704-8f41-4b21-a71e-ac4c3b2cac53 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:36.328079 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-de0d5b4f-de36-4793-a28f-7664eeae7d21 req-2c6a6704-8f41-4b21-a71e-ac4c3b2cac53 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1439748
Jun 01 18:49:36.435936 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-de0d5b4f-de36-4793-a28f-7664eeae7d21 req-7bb34bb7-c706-42bd-a470-0e973b6dc044 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1002471
Jun 01 18:49:36.445935 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 8b8474fc-cdc4-4213-9f90-4b017b63dded triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:36.446651 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:36.737181 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-076ee8da-1e2e-486e-8330-2c1856f17abe req-921b6763-1377-4fc6-ae4a-a15f8f69264e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4540458
Jun 01 18:49:36.795822 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-38b2d8ce-19c0-483f-b3ce-d5df575a306a service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5655894
Jun 01 18:49:36.808746 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:36.837594 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Transition to ACTIVE for port object 4253cb22-c78c-4cb6-8246-3860c05dfd90 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:36.858894 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:36.878856 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:36.881819 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e8339c-0066-4033-95e7-7eb19a6cffae req-bc2c9da5-8c95-4ca0-96a9-51af496d49cc tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:36.901637 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97e8339c-0066-4033-95e7-7eb19a6cffae req-bc2c9da5-8c95-4ca0-96a9-51af496d49cc tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.2616289
Jun 01 18:49:36.995069 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97e8339c-0066-4033-95e7-7eb19a6cffae req-4e65c299-107d-49df-82fb-6c117ed286d9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1005106
Jun 01 18:49:37.011466 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ffd3220-16a9-42e9-9d30-ec464b20c612 req-a04fc6c9-c584-4cc4-9d08-e800c248405b service neutron] 10.222.0.25 "GET /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2058020
Jun 01 18:49:37.026847 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Pushing event updated for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:37.030824 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:37.288292 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322ce69f-aa83-4cd7-830a-4597a9e968d5 req-74a9938d-3299-4e1a-8822-270f51bba0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:37.289854 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-322ce69f-aa83-4cd7-830a-4597a9e968d5 req-74a9938d-3299-4e1a-8822-270f51bba0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1917531
Jun 01 18:49:37.323329 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Attempting to bind port 4253cb22-c78c-4cb6-8246-3860c05dfd90 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:37.326748 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Attempting to bind port 4253cb22-c78c-4cb6-8246-3860c05dfd90 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:37.327241 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Attempting to bind port 4253cb22-c78c-4cb6-8246-3860c05dfd90 on network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:37.343068 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:37.348781 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Checking segment: {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:37.349282 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:37.349770 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Bound using segment: {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:37.350385 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Bound port: 4253cb22-c78c-4cb6-8246-3860c05dfd90, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f8613a04-61a1-4be3-8e1e-105a7c0512c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 62, 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:37.350875 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:37.466041 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-322ce69f-aa83-4cd7-830a-4597a9e968d5 req-89ffcddd-4d76-484a-873a-afc97fca83af tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1658223
Jun 01 18:49:37.539131 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] For port 4253cb22-c78c-4cb6-8246-3860c05dfd90, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:37.546229 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] For port 4253cb22-c78c-4cb6-8246-3860c05dfd90, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=4253cb22-c78c-4cb6-8246-3860c05dfd90,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:37.552621 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:37.556596 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:37.739812 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:37.740487 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce0816a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:37.853391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b860d01-fc82-484e-baf2-92f428cbe7fd req-55983034-6b67-4645-99fd-833653116e6a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:37.858431 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b34cd60-6876-4ced-abfd-9a84660853f4 req-87cc6e30-e328-4500-addc-53335563b55b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:37.860759 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2b860d01-fc82-484e-baf2-92f428cbe7fd req-55983034-6b67-4645-99fd-833653116e6a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.1012869
Jun 01 18:49:37.867364 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b34cd60-6876-4ced-abfd-9a84660853f4 req-87cc6e30-e328-4500-addc-53335563b55b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1933148
Jun 01 18:49:37.938893 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2b860d01-fc82-484e-baf2-92f428cbe7fd req-f8ee38e2-998f-4ba2-bc63-24fb08149ee7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0748930
Jun 01 18:49:37.944941 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b34cd60-6876-4ced-abfd-9a84660853f4 req-c0695c20-b2f2-4b9c-8079-7f75a5df03a2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0681958
Jun 01 18:49:38.066376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:38.151114 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Pushing event updated for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:38.159204 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.602s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:38.230201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641b090c-bae4-47ab-8cc2-3828e56749ab req-149944b4-b133-4e39-bd8a-a91b4a9ccda6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:38.231824 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-641b090c-bae4-47ab-8cc2-3828e56749ab req-149944b4-b133-4e39-bd8a-a91b4a9ccda6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.1164985
Jun 01 18:49:38.291462 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-641b090c-bae4-47ab-8cc2-3828e56749ab req-68472d39-31b3-4074-89c1-dca72cf8abe1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530970
Jun 01 18:49:38.444763 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce0816a0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:33Z', 'revision_number': 4, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '4253cb22-c78c-4cb6-8246-3860c05dfd90', 'name': '', 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'tenant_id': '742cd095d98847558adeaa435437024e', 'mac_address': 'fa:16:3e:91:86:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:32Z', 'updated_at': '2021-06-01T18:49:37Z', 'revision_number': 4, 'project_id': '742cd095d98847558adeaa435437024e', 'subnets': [{'id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:38.449520 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ec98bd8-b964-4f4c-a7f7-91278f6b9850 None None] The sync data for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi is: [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:49:33Z', 'revision_number': 4, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '4253cb22-c78c-4cb6-8246-3860c05dfd90', 'name': '', 'network_id': '670539f1-1de1-4f09-80bf-a0edd1cf2a6e', 'tenant_id': '742cd095d98847558adeaa435437024e', 'mac_address': 'fa:16:3e:91:86:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:32Z', 'updated_at': '2021-06-01T18:49:37Z', 'revision_number': 4, 'project_id': '742cd095d98847558adeaa435437024e', 'subnets': [{'id': '2051909f-1c03-4f79-b469-2b5fd38c2cd4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:49:38.796417 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b432bcab-ed13-494e-b933-000708957352 req-92482175-3df0-49bf-bfcc-8794800736c6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:38.805312 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b432bcab-ed13-494e-b933-000708957352 req-92482175-3df0-49bf-bfcc-8794800736c6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1447732
Jun 01 18:49:38.893405 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b432bcab-ed13-494e-b933-000708957352 req-a0d30d71-8bf8-44dc-839f-5e0899a4e697 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0865624
Jun 01 18:49:39.007799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 69b10932-a965-4259-8f8c-39d6322653b1 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:49:39.012886 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:39.172813 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.231991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7eb436d-9a23-4320-916f-abdd926dcc05 req-b14465ff-b24f-42c1-ac96-5a79818cec07 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:39.240899 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a7eb436d-9a23-4320-916f-abdd926dcc05 req-b14465ff-b24f-42c1-ac96-5a79818cec07 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.1268027
Jun 01 18:49:39.295174 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a7eb436d-9a23-4320-916f-abdd926dcc05 req-829bfa41-b044-4c82-ab38-027d1421e0a9 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533247
Jun 01 18:49:39.329681 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 0721dbfe-8c91-42f7-b953-19fcbeb01603 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:39.387862 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84a961b-c915-4a22-a5b4-6e9978b8c16f req-fb32dad9-0158-4f16-b359-210b957b9fd6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:39.389125 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 0721dbfe-8c91-42f7-b953-19fcbeb01603 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:39.389510 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.391420 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f84a961b-c915-4a22-a5b4-6e9978b8c16f req-fb32dad9-0158-4f16-b359-210b957b9fd6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1873217
Jun 01 18:49:39.516870 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f84a961b-c915-4a22-a5b4-6e9978b8c16f req-44ba2811-45ac-436a-a8bc-10d60656a021 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1166806
Jun 01 18:49:39.525747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=69b10932-a965-4259-8f8c-39d6322653b1,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:39.556570 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '69b10932-a965-4259-8f8c-39d6322653b1', 'network_id': '2bc7607a-0e83-4423-b9b7-ac3e13607a13', 'port_id': '69b10932-a965-4259-8f8c-39d6322653b1', 'mac_address': 'fa:16:3e:8a:fa:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 92, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b40008fb-ef5f-4ddd-be90-93c9dd2d5423', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:49:39.585103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85db5594-b179-48f0-8f73-0b9a5a48d499 req-a579934d-8dc4-4af7-bcf2-d821ff27c72e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:39.593662 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-85db5594-b179-48f0-8f73-0b9a5a48d499 req-a579934d-8dc4-4af7-bcf2-d821ff27c72e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 944 time: 0.1493626
Jun 01 18:49:39.662378 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-85db5594-b179-48f0-8f73-0b9a5a48d499 req-07880623-8dba-4d18-a914-4c25a9c29592 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0673139
Jun 01 18:49:39.677725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.690349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.733287 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:39.735686 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-570ee77b-e4d6-4969-9acc-495bfdd6d04f" -d '{"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:39.739736 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 69b10932-a965-4259-8f8c-39d6322653b1 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:39.761781 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=69b10932-a965-4259-8f8c-39d6322653b1,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:39.786874 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.804449 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:39.806303 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:39.841079 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4dbbc7f-2160-4692-989e-003dd59995dd x-openstack-request-id: req-d4dbbc7f-2160-4692-989e-003dd59995dd {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:39.841469 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:39.841790 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d4dbbc7f-2160-4692-989e-003dd59995dd {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:39.842241 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'code': 200}
Jun 01 18:49:39.843506 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:39.900334 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:39.903616 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:39.904515 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-d65a8c7d-29fc-4af2-896b-4c7c78acb463 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.053s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:39.984616 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:39.996680 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:40.165472 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 4253cb22-c78c-4cb6-8246-3860c05dfd90 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:40.241289 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7dea04-9c16-44a7-9472-46d1be8e9bb2 req-f1454f20-bd58-4a1b-bc7e-34f2de77ccfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:40.242831 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ec7dea04-9c16-44a7-9472-46d1be8e9bb2 req-f1454f20-bd58-4a1b-bc7e-34f2de77ccfd service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.1221750
Jun 01 18:49:40.260268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['69b10932-a965-4259-8f8c-39d6322653b1'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:40.355561 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82fb3ea-fd4c-47d8-bbce-2fa078db0c75 req-a5e742f4-e596-4f94-8550-f156290b8ebf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:40.371000 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d82fb3ea-fd4c-47d8-bbce-2fa078db0c75 req-a5e742f4-e596-4f94-8550-f156290b8ebf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.2596209
Jun 01 18:49:40.378385 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ec7dea04-9c16-44a7-9472-46d1be8e9bb2 req-9f461879-d47d-4642-8d29-cb29eed0bd00 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1261339
Jun 01 18:49:40.395073 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:40.401964 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:40.402862 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:40.475766 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d82fb3ea-fd4c-47d8-bbce-2fa078db0c75 req-fd4195f8-8837-4ee7-83df-a904fb774e02 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1065824
Jun 01 18:49:40.641351 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:40.708992 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 4253cb22-c78c-4cb6-8246-3860c05dfd90, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=4253cb22-c78c-4cb6-8246-3860c05dfd90,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:40.715372 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:40.717650 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:40.735132 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84d6457-ed6e-4fba-be2e-f515f2a69eab req-c366bbb7-f5b0-4f37-988d-2ed2ae99e2cf tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:40.750711 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b84d6457-ed6e-4fba-be2e-f515f2a69eab req-c366bbb7-f5b0-4f37-988d-2ed2ae99e2cf tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1821690
Jun 01 18:49:40.806070 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:40.809426 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:40.810823 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b84d6457-ed6e-4fba-be2e-f515f2a69eab req-702cc9f4-ce13-44a9-a94a-6c60658ab6e6 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0591724
Jun 01 18:49:40.858550 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f660ca-de76-4608-9492-6987a68734fa req-2d58af9d-1287-4351-acd8-a2fb1efcec32 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:40.865910 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-87f660ca-de76-4608-9492-6987a68734fa req-2d58af9d-1287-4351-acd8-a2fb1efcec32 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1888287
Jun 01 18:49:40.914907 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-87f660ca-de76-4608-9492-6987a68734fa req-80dffe7e-12e2-4271-a6e1-bbf70f6f13e9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0482807
Jun 01 18:49:40.999782 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2afaa77e-c160-4108-b1aa-1e5e949c9457 req-2c124690-af4b-47ad-a1de-22540b774116 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:41.001408 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2afaa77e-c160-4108-b1aa-1e5e949c9457 req-2c124690-af4b-47ad-a1de-22540b774116 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 945 time: 0.0875626
Jun 01 18:49:41.052953 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2afaa77e-c160-4108-b1aa-1e5e949c9457 req-1d71d2d8-606d-4919-880b-df3ab525930a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449839
Jun 01 18:49:41.747439 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d93328-efb9-477c-8aa0-01bcc9b47088 req-51792e38-7230-43ae-a468-5fc5b56a4ca5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:41.756117 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-38d93328-efb9-477c-8aa0-01bcc9b47088 req-51792e38-7230-43ae-a468-5fc5b56a4ca5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1138537
Jun 01 18:49:41.803962 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-38d93328-efb9-477c-8aa0-01bcc9b47088 req-61c5fc51-6fec-4368-9d3c-a60a69ad94c8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467744
Jun 01 18:49:42.031848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3f4706-472a-4b46-a224-3d6a5f3a10d4 req-faf6e759-4705-456d-9a2f-5ce7ed07d3eb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:42.039172 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb3f4706-472a-4b46-a224-3d6a5f3a10d4 req-faf6e759-4705-456d-9a2f-5ce7ed07d3eb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1163867
Jun 01 18:49:42.120714 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb3f4706-472a-4b46-a224-3d6a5f3a10d4 req-d9bf31e2-1366-4c6f-b529-7259cd57330b tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0786676
Jun 01 18:49:42.125595 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 4253cb22-c78c-4cb6-8246-3860c05dfd90 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:42.211880 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233c9071-ef08-4135-9512-2ed5f8e88f34 req-bb34c4c3-f990-484b-8768-824468909a13 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:42.214289 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-233c9071-ef08-4135-9512-2ed5f8e88f34 req-bb34c4c3-f990-484b-8768-824468909a13 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1137068
Jun 01 18:49:42.285452 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 4253cb22-c78c-4cb6-8246-3860c05dfd90 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:42.285843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:42.293902 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-233c9071-ef08-4135-9512-2ed5f8e88f34 req-2e71e8be-683d-4011-9339-aba0251cd126 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0707402
Jun 01 18:49:42.440921 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f827532-ca2d-49e7-8690-9b012f4058a4 req-6fc8ffa1-3e6f-4ef7-8f7a-ec139e5fffb6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:42.442544 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f827532-ca2d-49e7-8690-9b012f4058a4 req-6fc8ffa1-3e6f-4ef7-8f7a-ec139e5fffb6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 945 time: 0.1167593
Jun 01 18:49:42.514074 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f827532-ca2d-49e7-8690-9b012f4058a4 req-000d37dd-2403-4cb8-864b-6b83c526bf8d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0650535
Jun 01 18:49:42.576402 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249ee0f9-f83f-474e-b360-ccebfeb3675b req-69b48fee-0569-4dff-811c-68b6bbb4ddce tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:42.583994 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-249ee0f9-f83f-474e-b360-ccebfeb3675b req-69b48fee-0569-4dff-811c-68b6bbb4ddce tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1789312
Jun 01 18:49:42.680952 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-249ee0f9-f83f-474e-b360-ccebfeb3675b req-c62100e9-a644-4be1-8694-179922dc56cb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0956819
Jun 01 18:49:42.687796 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35914) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:42.961890 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-621bcb71-6b68-4cc0-adb9-78216d103bfa tempest-TestShelveInstance-389515811 tempest-TestShelveInstance-389515811-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:42.962632 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-621bcb71-6b68-4cc0-adb9-78216d103bfa tempest-TestShelveInstance-389515811 tempest-TestShelveInstance-389515811-project-admin] Synchronizing usage tracker for tenant:0b98a000057541b9ab9d7a211142b5ee on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:42.987577 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-621bcb71-6b68-4cc0-adb9-78216d103bfa tempest-TestShelveInstance-389515811 tempest-TestShelveInstance-389515811-project-admin] Unset dirty status for tenant:0b98a000057541b9ab9d7a211142b5ee on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:42.989200 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-621bcb71-6b68-4cc0-adb9-78216d103bfa tempest-TestShelveInstance-389515811 tempest-TestShelveInstance-389515811-project-admin] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1093 time: 0.3001807
Jun 01 18:49:42.991764 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 35924) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:49:42.998901 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'fixed_ip_address': '172.20.0.5'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:43.008010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:43.012043 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Usage tracker for resource:floatingip and tenant:85f17a1d02ae4454a980be1331cbe34d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:49:43.015048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:49:43.021073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:43.041145 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for floatingip, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.043033 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:49:43.050126 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1367dc04-2716-44bb-83b7-6f8a6676e6b2 req-84d26a08-8eac-482e-b652-d4d7d4a8aa5f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:43.051672 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1367dc04-2716-44bb-83b7-6f8a6676e6b2 req-84d26a08-8eac-482e-b652-d4d7d4a8aa5f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1024618
Jun 01 18:49:43.156704 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1367dc04-2716-44bb-83b7-6f8a6676e6b2 req-c3939617-5161-45c9-b226-11e60cc34dbe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0974550
Jun 01 18:49:43.248649 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 69b10932-a965-4259-8f8c-39d6322653b1 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:43.317834 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:43.340635 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:49:43.419622 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 69b10932-a965-4259-8f8c-39d6322653b1 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:43.431084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.451788 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 69b10932-a965-4259-8f8c-39d6322653b1 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:43.453318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.499304 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:43.518468 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.552457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:43.562108 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.564090 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:43.678526 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23901d25-a485-4413-88d7-806e90671185 req-c4d34086-99a4-411f-8a26-606c1f74cd8f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:43.685864 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-23901d25-a485-4413-88d7-806e90671185 req-c4d34086-99a4-411f-8a26-606c1f74cd8f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.2263248
Jun 01 18:49:43.712217 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.741815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=6']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:43.749734 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:43.771044 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-23901d25-a485-4413-88d7-806e90671185 req-7208ec4c-07f8-4db8-9bd8-a91eb1acf212 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0838008
Jun 01 18:49:43.779568 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:43.784967 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23f87b90-4b46-4f19-bb5e-a440bf610efa" -d '{"events": [{"server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "name": "network-vif-plugged", "status": "completed", "tag": "69b10932-a965-4259-8f8c-39d6322653b1"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:43.793512 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:49:43.801856 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Allocated IP 172.27.0.109 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/bf9fa831-6b84-418f-8ba1-1e6dad14722d) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:43.835553 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=69b10932-a965-4259-8f8c-39d6322653b1,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:43.843049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265935d7-8908-499e-ab65-075a2ddf34bb req-1a4c692f-373d-4c91-9fa9-1d5157bfb6a2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:43.853548 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-265935d7-8908-499e-ab65-075a2ddf34bb req-1a4c692f-373d-4c91-9fa9-1d5157bfb6a2 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 945 time: 0.1404417
Jun 01 18:49:43.864170 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:43.886307 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:43.940778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cb33a35-fbea-47d3-99a4-c20d71f3ed6c x-openstack-request-id: req-1cb33a35-fbea-47d3-99a4-c20d71f3ed6c {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:43.941466 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "name": "network-vif-plugged", "status": "completed", "tag": "69b10932-a965-4259-8f8c-39d6322653b1", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:43.942075 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-1cb33a35-fbea-47d3-99a4-c20d71f3ed6c {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:43.942703 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1', 'code': 200}
Jun 01 18:49:44.120842 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-265935d7-8908-499e-ab65-075a2ddf34bb req-9c5c4373-3020-49e0-95c9-c2d9fb1e1653 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2662570
Jun 01 18:49:44.233808 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:44.245359 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.359s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:44.288208 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1b91728d-bc65-4df3-8cd1-e1ae89872590 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:44.314081 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:44.443747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec08923-843a-4fa4-9840-6fab74e06ffc req-fff7a801-eaba-4369-a10b-d536c3287f8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:44.445840 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ec08923-843a-4fa4-9840-6fab74e06ffc req-fff7a801-eaba-4369-a10b-d536c3287f8d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 1099 time: 0.1314201
Jun 01 18:49:44.448500 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:44.454497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:44.523687 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ec08923-843a-4fa4-9840-6fab74e06ffc req-1815c9b8-0c15-48f3-83b5-a59d89250fb0 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599205
Jun 01 18:49:44.524678 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a85b889-66ca-4c4f-bf57-61a90c682c7a req-1a7c2222-c649-4178-beb0-e22df497ef6a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:44.526181 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a85b889-66ca-4c4f-bf57-61a90c682c7a req-1a7c2222-c649-4178-beb0-e22df497ef6a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1740620
Jun 01 18:49:44.551631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:44.562991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:44.572237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:44.624360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'Port': ['ID=bf9fa831-6b84-418f-8ba1-1e6dad14722d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:44.633358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:44.651075 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a85b889-66ca-4c4f-bf57-61a90c682c7a req-c546827e-4b6e-4be7-bb99-06da3c2f3379 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1138113
Jun 01 18:49:44.988518 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97776bfa-aff5-4cc1-a81e-e8e5cfe490d2 req-0f189543-e3b6-42ad-8d4c-faf83cd98987 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:45.001451 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-97776bfa-aff5-4cc1-a81e-e8e5cfe490d2 req-0f189543-e3b6-42ad-8d4c-faf83cd98987 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 944 time: 0.1123462
Jun 01 18:49:45.050086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:49:45.075907 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-97776bfa-aff5-4cc1-a81e-e8e5cfe490d2 req-2be0e241-fef3-45a2-a248-811a767e30b9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0730326
Jun 01 18:49:45.161544 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.202709 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:45.203104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.232695 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-5fefefaf-59d0-4c53-af7d-8c997d5f90a9 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0946600
Jun 01 18:49:45.302751 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.365556 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-28002895-646e-4355-ad55-a1ae40aa5fba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:45.367214 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-28002895-646e-4355-ad55-a1ae40aa5fba service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.0990770
Jun 01 18:49:45.572563 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.641098 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:49:45.650350 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.656343 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:45.663807 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6822941e-ead4-478d-9291-bb662ca1bd5b req-9c04d472-f14e-4b40-b4e3-662a828c86df tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:45.665508 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6822941e-ead4-478d-9291-bb662ca1bd5b req-9c04d472-f14e-4b40-b4e3-662a828c86df tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.2885375
Jun 01 18:49:45.709443 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-177cc6b1-1021-4b51-af05-298a1666e52e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:45.710888 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-177cc6b1-1021-4b51-af05-298a1666e52e service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.3025775
Jun 01 18:49:45.737706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.747728 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6822941e-ead4-478d-9291-bb662ca1bd5b req-0a57f323-97db-4c06-97b0-7a54350ef4f4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680521
Jun 01 18:49:45.753987 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.759153 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:45.812549 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=7']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:45.816301 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:45.824854 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-5694e8d2-06ac-4441-b7b7-175af96b978c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.0995791
Jun 01 18:49:45.899483 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event updated for resources: {'Port': ['ID=bf9fa831-6b84-418f-8ba1-1e6dad14722d,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:45.904155 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:45.911512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:45.944583 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:45.946881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2defc5fa-0524-4371-843f-7b12ed4d95fe" -d '{"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:45.951888 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-98f80853-c28d-4473-b496-5aa2c6cb8296 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:45.953620 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-98f80853-c28d-4473-b496-5aa2c6cb8296 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0728652
Jun 01 18:49:46.018669 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-c1c7d025-589d-4a77-a685-c19d3b28ad88 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0515976
Jun 01 18:49:46.070486 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43c28325-f82b-490c-b2c4-4aa6aac4d3f9 x-openstack-request-id: req-43c28325-f82b-490c-b2c4-4aa6aac4d3f9 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:46.070896 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:46.071283 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-43c28325-f82b-490c-b2c4-4aa6aac4d3f9 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:46.071867 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'code': 200}
Jun 01 18:49:46.117439 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b574cdd-8f83-4007-8941-ce1e00a59075 req-a01b7052-90ff-4fe4-8eb1-84fbec694bda tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:46.124411 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0b574cdd-8f83-4007-8941-ce1e00a59075 req-a01b7052-90ff-4fe4-8eb1-84fbec694bda tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.2972348
Jun 01 18:49:46.223795 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Floating IP 6676a94a-cc1e-4c7d-9493-532fe0d81c3b associated. External IP: 172.27.0.109, port: 0721dbfe-8c91-42f7-b953-19fcbeb01603.
Jun 01 18:49:46.253337 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0b574cdd-8f83-4007-8941-ce1e00a59075 req-a53f2665-8c61-4bcf-8d3d-98c2b75149b6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1278307
Jun 01 18:49:46.365602 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-6b8f8749-4577-425e-8ad7-edcdf77eab33 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3258357
Jun 01 18:49:46.626417 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb399631-c9ef-4308-a0ec-5e93b5398ae6 req-137c7d08-0db6-4fde-9c5d-ee02cc79d8a1 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2473269
Jun 01 18:49:46.675950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf7e5a3-bcf1-426d-88a3-941abc241944 req-ec7a674f-8746-44d2-87bb-5bce6e5e6c6c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:46.683853 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5cf7e5a3-bcf1-426d-88a3-941abc241944 req-ec7a674f-8746-44d2-87bb-5bce6e5e6c6c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.2240465
Jun 01 18:49:46.715091 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-0a81414c-9abe-4dd4-9416-30c366e3de5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:46.838457 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5cf7e5a3-bcf1-426d-88a3-941abc241944 req-6328254d-fd4c-4201-8356-08ff5ee4d012 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1536672
Jun 01 18:49:46.854981 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:46.886319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-43e6e149-cd8a-4eda-b562-b42aa6d27ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:46.888063 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-43e6e149-cd8a-4eda-b562-b42aa6d27ccd service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.1664081
Jun 01 18:49:46.967682 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb609a1-fbde-4062-9888-9f87e8cfc964 req-5fe11d4e-914e-4f94-968b-d8c5d6b12f34 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:46.975290 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feb609a1-fbde-4062-9888-9f87e8cfc964 req-5fe11d4e-914e-4f94-968b-d8c5d6b12f34 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1930285
Jun 01 18:49:46.992811 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Router 950c7042-42b1-4123-9d8b-78b7f84afa7f has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:49:47.109603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-95f27dcc-6838-4de6-a4e7-7a5306f7c623 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:47.111274 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-95f27dcc-6838-4de6-a4e7-7a5306f7c623 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.2112350
Jun 01 18:49:47.113464 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feb609a1-fbde-4062-9888-9f87e8cfc964 req-e3dcce54-042d-4a15-9a69-0514f3a9a0da tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1370828
Jun 01 18:49:47.128904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcfbbdb4-15b6-49e4-9306-865d31c7daf8 req-97bb4fdd-e384-49e4-bf72-94515f108fad tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:47.130562 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fcfbbdb4-15b6-49e4-9306-865d31c7daf8 req-97bb4fdd-e384-49e4-bf72-94515f108fad tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.1225288
Jun 01 18:49:47.218069 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-cf292812-30c9-4d91-a2dc-4e20796555ab service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.0866930
Jun 01 18:49:47.290366 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:49:47.302914 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fcfbbdb4-15b6-49e4-9306-865d31c7daf8 req-7cc7190d-b45c-4a39-b289-3bd106a997cc tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1157725
Jun 01 18:49:47.304282 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Sync routers for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:49:47.332668 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:47.336650 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:47.337611 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0e250>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:47.349463 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-05240885-4043-4726-aacc-c4305734b1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:47.354732 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-05240885-4043-4726-aacc-c4305734b1a3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.1158891
Jun 01 18:49:47.465980 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-f47dded3-cfcf-41c7-876c-f3071e8973ca service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0762579
Jun 01 18:49:47.470131 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 4.4773359
Jun 01 18:49:47.471695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:47.477221 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7" -d '{"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:47.574585 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1f5eb79-2e23-42d0-945f-95088dc51487 x-openstack-request-id: req-e1f5eb79-2e23-42d0-945f-95088dc51487 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:47.575832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:47.576335 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e1f5eb79-2e23-42d0-945f-95088dc51487 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:47.577185 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'status': 'completed', 'code': 200}
Jun 01 18:49:47.760876 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb65d06-66f0-42f0-8df5-27b7336c1559 req-20d9a268-9016-405d-8aa2-e89ebe380889 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:47.776584 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:47.780875 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9fb65d06-66f0-42f0-8df5-27b7336c1559 req-20d9a268-9016-405d-8aa2-e89ebe380889 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.2004719
Jun 01 18:49:47.795617 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:47.797170 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-bcd132e7-a9cb-49c5-869b-b378a893c5ee service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2929585
Jun 01 18:49:47.836868 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9fb65d06-66f0-42f0-8df5-27b7336c1559 req-66a9a6f6-ece9-4df6-8a53-c5243fcf7fc7 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0548987
Jun 01 18:49:47.914309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-53d25d3e-ad8a-4c64-8c11-8e7698aee691 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:47.915799 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-53d25d3e-ad8a-4c64-8c11-8e7698aee691 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.2818387
Jun 01 18:49:48.414495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55c3468-5224-4020-86b0-05b9ce6b1924 req-900d97df-ab98-456e-a2b8-1acc223f3e3a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:48.416078 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d55c3468-5224-4020-86b0-05b9ce6b1924 req-900d97df-ab98-456e-a2b8-1acc223f3e3a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1867740
Jun 01 18:49:48.455105 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0e250>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '6676a94a-cc1e-4c7d-9493-532fe0d81c3b', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'floating_ip_address': '172.27.0.109', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'mac_address': 'fa:16:3e:84:e4:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:49:45Z', 'updated_at': '2021-06-01T18:49:45Z', 'revision_number': 0, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:48.462110 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Checking router: 950c7042-42b1-4123-9d8b-78b7f84afa7f for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:49:48.472208 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:49:48.472860 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0e250>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:49:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:48.497320 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a384ac9b-73af-49c4-9619-6d3bb4b204e2 req-a32bd971-df65-489d-9ba8-475f28698707 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6850145
Jun 01 18:49:48.547710 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d55c3468-5224-4020-86b0-05b9ce6b1924 req-1e1c7f65-1544-422f-a39f-64871909a715 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1222837
Jun 01 18:49:48.592169 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3882326-3f36-4869-a53e-389523e3e8f2 req-88df0e42-d6cb-476e-a902-e236ac156cb3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:48.600443 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b3882326-3f36-4869-a53e-389523e3e8f2 req-88df0e42-d6cb-476e-a902-e236ac156cb3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.5831368
Jun 01 18:49:48.641501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-3ab6461f-3b5a-40a9-9f29-77c48b97e11c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:48.643608 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-3ab6461f-3b5a-40a9-9f29-77c48b97e11c service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.6472538
Jun 01 18:49:48.646458 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b3882326-3f36-4869-a53e-389523e3e8f2 req-8db0ff54-9e8f-4a02-9950-360214dfefe5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452430
Jun 01 18:49:48.767950 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:49:48.786494 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-310fedad-5c67-4456-b838-906ff08c45ee service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 999 time: 0.1280892
Jun 01 18:49:48.882795 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-466b3380-6466-4427-b81b-a9915226b49f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:48.884261 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-466b3380-6466-4427-b81b-a9915226b49f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0896745
Jun 01 18:49:48.999787 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-152db224-6c72-43bc-a3dc-1d440dd0baa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:49.002388 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-152db224-6c72-43bc-a3dc-1d440dd0baa8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1039512
Jun 01 18:49:49.163170 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341de528-125c-4c58-bffa-42fcd2be714b req-cca9bbea-bfce-4830-b49b-3975e00bde09 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:49.173801 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-f80d64e2-11d7-4c77-bb90-43ce92cb4c56 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1586761
Jun 01 18:49:49.176784 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-341de528-125c-4c58-bffa-42fcd2be714b req-cca9bbea-bfce-4830-b49b-3975e00bde09 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1783905
Jun 01 18:49:49.264754 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-341de528-125c-4c58-bffa-42fcd2be714b req-197990f4-8213-428a-9d72-e7629bb679e0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0791609
Jun 01 18:49:49.308824 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0e250>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '6676a94a-cc1e-4c7d-9493-532fe0d81c3b', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'floating_ip_address': '172.27.0.109', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'mac_address': 'fa:16:3e:84:e4:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:49:45Z', 'updated_at': '2021-06-01T18:49:45Z', 'revision_number': 0, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:49:49.316224 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a81e87b-ae9e-4198-a922-62fb1236cc0f None None] The sync data for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi is: [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '6676a94a-cc1e-4c7d-9493-532fe0d81c3b', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'floating_ip_address': '172.27.0.109', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 365, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'mac_address': 'fa:16:3e:84:e4:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:49:45Z', 'updated_at': '2021-06-01T18:49:45Z', 'revision_number': 0, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:49:49.390821 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-37d31a0a-132d-43ee-9db3-7fdc1eb486e7 req-6cde78fa-2b95-4e66-85f1-e304c36487a3 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2053511
Jun 01 18:49:49.544411 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:49.783274 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f87ff971-6b8e-4770-aee9-c9d0be023c58 None None] New status for floating IP 6676a94a-cc1e-4c7d-9493-532fe0d81c3b: ACTIVE {{(pid=98260) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:49:49.893834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67cc766-7ead-4d77-a6c7-c7defdfd7a17 req-ac5480a7-a762-4735-ace6-5a395fd0d56c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:49.905436 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b67cc766-7ead-4d77-a6c7-c7defdfd7a17 req-ac5480a7-a762-4735-ace6-5a395fd0d56c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1722503
Jun 01 18:49:49.990641 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b67cc766-7ead-4d77-a6c7-c7defdfd7a17 req-d78de09b-5557-40d0-a319-a2aa80589cf6 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0734172
Jun 01 18:49:50.274401 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bb654e-ac8f-4288-8139-c662d194e051 req-28db187c-5411-4287-a358-d2c167258505 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:50.281414 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84bb654e-ac8f-4288-8139-c662d194e051 req-28db187c-5411-4287-a358-d2c167258505 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1407344
Jun 01 18:49:50.331744 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84bb654e-ac8f-4288-8139-c662d194e051 req-7891ba4a-14ba-412d-8019-493d59dcfbe6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0494218
Jun 01 18:49:50.500265 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc61ea1-65d7-4ced-a522-05770bf8b6cd req-64a80cdc-d047-4766-a450-c64019574528 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:50.502102 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9fc61ea1-65d7-4ced-a522-05770bf8b6cd req-64a80cdc-d047-4766-a450-c64019574528 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0903749
Jun 01 18:49:50.552543 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9fc61ea1-65d7-4ced-a522-05770bf8b6cd req-93580c0e-dd2e-406c-a96f-cf949c6d9f15 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440214
Jun 01 18:49:51.223518 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-eca97fb1-ad4e-4aad-b67a-1dcc0b8b45ad tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:51.224237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-eca97fb1-ad4e-4aad-b67a-1dcc0b8b45ad tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:network {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:51.242814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-eca97fb1-ad4e-4aad-b67a-1dcc0b8b45ad tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:network {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:51.244148 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-eca97fb1-ad4e-4aad-b67a-1dcc0b8b45ad tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 814 time: 0.1964655
Jun 01 18:49:51.259729 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-bbe868ed-500a-4b8b-b93d-e29c3eebaf20 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/quotas/35f75df4cb564b1dad14fd0d02d3c46b HTTP/1.1" status: 200  len: 375 time: 0.0101266
Jun 01 18:49:51.310979 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c739d24-3820-4794-af2c-50b683737b4b req-31f347b3-5199-45a3-91f7-82ae6eaff201 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:51.312797 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c739d24-3820-4794-af2c-50b683737b4b req-31f347b3-5199-45a3-91f7-82ae6eaff201 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1899505
Jun 01 18:49:51.369740 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-5ffb49fc-3264-45a2-a3cf-590ffba4d37a tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1001711
Jun 01 18:49:51.399021 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c739d24-3820-4794-af2c-50b683737b4b req-937a54cf-d1f9-47b8-ab0b-6c6f75dbe7dc tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794785
Jun 01 18:49:51.530941 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-264e36ff-3005-400f-b65c-6c5d84b7e48b service neutron] 10.222.0.22 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1601117
Jun 01 18:49:51.619982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645d1db2-1d3a-4144-bfac-052d630f7c9e req-cbde4ce7-1b4b-41dd-b8a8-a5a872156b79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:51.623199 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-645d1db2-1d3a-4144-bfac-052d630f7c9e req-cbde4ce7-1b4b-41dd-b8a8-a5a872156b79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1131234
Jun 01 18:49:51.696539 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-645d1db2-1d3a-4144-bfac-052d630f7c9e req-b3678c8c-0b19-4bab-880d-f53408c368d8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0570292
Jun 01 18:49:51.704001 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-a32ddd3a-5b1f-42dd-9c8e-0c83285e2765 service neutron] 10.222.0.22 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1667137
Jun 01 18:49:51.921418 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ba006b78-594c-4927-b996-3c99fa681c2e req-0bf05346-0e68-4d8c-a532-03b73cb8971e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 210 time: 0.0452724
Jun 01 18:49:51.986045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9d0b35-7a64-4c4a-b012-bcc8ec6aa975 req-45364781-3829-4f28-b081-1eae500a31d6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:51.987741 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f9d0b35-7a64-4c4a-b012-bcc8ec6aa975 req-45364781-3829-4f28-b081-1eae500a31d6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1443408
Jun 01 18:49:52.054174 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f9d0b35-7a64-4c4a-b012-bcc8ec6aa975 req-8cb3c4c4-74fd-43e0-98fe-bb525135ff8b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0602551
Jun 01 18:49:52.492085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff8f2f3-3c6a-4d8b-8fb4-8bef1b23b994 req-477ad8eb-b54e-45fc-9088-cb7890a5d2b4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:52.495645 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8ff8f2f3-3c6a-4d8b-8fb4-8bef1b23b994 req-477ad8eb-b54e-45fc-9088-cb7890a5d2b4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1433914
Jun 01 18:49:52.604180 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8ff8f2f3-3c6a-4d8b-8fb4-8bef1b23b994 req-992a2d83-a1af-4002-8fe2-a7841dadbf0d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1018827
Jun 01 18:49:52.718376 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-649a5aab-e1b9-46dd-bfce-84b3ecfa2dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:52.720017 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-649a5aab-e1b9-46dd-bfce-84b3ecfa2dd0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1099 time: 0.2199287
Jun 01 18:49:52.973337 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b8617f5-f521-49ae-b6fa-a94c0f192da1 req-ac80aa52-d819-4acd-9379-bb8c68bc114d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:52.982141 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b8617f5-f521-49ae-b6fa-a94c0f192da1 req-ac80aa52-d819-4acd-9379-bb8c68bc114d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1344898
Jun 01 18:49:53.012560 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff019ef5-447b-4e62-9025-f9919e9b5e01 req-5f8a3256-9e48-4bad-9d9d-eb847aaa9d16 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:53.014341 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff019ef5-447b-4e62-9025-f9919e9b5e01 req-5f8a3256-9e48-4bad-9d9d-eb847aaa9d16 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.3795431
Jun 01 18:49:53.036715 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b8617f5-f521-49ae-b6fa-a94c0f192da1 req-8273d8f6-de2a-47e0-baf2-f9ce9c43cbe4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0536411
Jun 01 18:49:53.072865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-e051c89e-50c2-4cd1-8580-5ead7cc4fd1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:53.074394 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-e051c89e-50c2-4cd1-8580-5ead7cc4fd1c service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.3161452
Jun 01 18:49:53.101077 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff019ef5-447b-4e62-9025-f9919e9b5e01 req-a86d1c90-b403-456b-887c-1803e88fa52c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0778217
Jun 01 18:49:53.218420 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-49da4608-d5ef-42a2-8557-02439ccf6845 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 1001 time: 0.1161747
Jun 01 18:49:53.234035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-cf20d7cb-e0cf-4901-a26e-baaed9656897 req-4d3a2bc8-70c4-4c8f-860c-06a3d8c4f33f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:53.255365 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-cf20d7cb-e0cf-4901-a26e-baaed9656897 req-4d3a2bc8-70c4-4c8f-860c-06a3d8c4f33f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:53.256661 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cf20d7cb-e0cf-4901-a26e-baaed9656897 req-4d3a2bc8-70c4-4c8f-860c-06a3d8c4f33f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 210 time: 0.0833662
Jun 01 18:49:53.309531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-67436cd8-a105-4202-8ee0-2e6f8f3741ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:53.312788 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-67436cd8-a105-4202-8ee0-2e6f8f3741ba service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.0868044
Jun 01 18:49:53.430746 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-2adb5642-1da8-493d-8a50-978e54abbdd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:53.432832 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-2adb5642-1da8-493d-8a50-978e54abbdd9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1096492
Jun 01 18:49:53.884407 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-1b03f353-2d1e-4626-aa5e-3002b909a563 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:53.885950 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-1b03f353-2d1e-4626-aa5e-3002b909a563 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 814 time: 0.4006646
Jun 01 18:49:53.918469 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'port': {'device_id': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'admin_state_up': True, 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:53.998218 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-c317f5ef-8028-4e8e-bb56-12a34ab601c6 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5554955
Jun 01 18:49:54.141356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45baa54d-85ef-4341-9a44-e6e7246c51ba req-f41c406d-d2b8-4a6d-b65c-eedddc2013f8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:54.149018 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-45baa54d-85ef-4341-9a44-e6e7246c51ba req-f41c406d-d2b8-4a6d-b65c-eedddc2013f8 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.3389356
Jun 01 18:49:54.285898 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:49:54.303389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d42f85-5025-40ec-bf8c-b9ed0e95c60e req-c3536a7e-8ccd-4c1a-83fa-4f605f926395 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:54.304928 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d42f85-5025-40ec-bf8c-b9ed0e95c60e req-c3536a7e-8ccd-4c1a-83fa-4f605f926395 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1226723
Jun 01 18:49:54.321657 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-45baa54d-85ef-4341-9a44-e6e7246c51ba req-3b61cd3f-f6c1-461b-95ab-ad9acd61c72d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1717083
Jun 01 18:49:54.329595 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:49:54.337580 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fc84cf72-8aac-4a34-b57f-ff6bf9b0e66d req-a9594e1d-a3f6-4044-8f5a-d2ad8a9e8edb service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2823505
Jun 01 18:49:54.365545 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Made reservation on behalf of 35f75df4cb564b1dad14fd0d02d3c46b for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:49:54.372616 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:54.387500 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d42f85-5025-40ec-bf8c-b9ed0e95c60e req-c579bdb2-eac3-4e11-ae3b-1947b2ef2590 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0770056
Jun 01 18:49:54.584759 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4a1b8524-a49a-4fc1-bf73-9da1e544d663 req-b082d96c-2159-42c4-a1cf-7cb71f4b5dab tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 210 time: 0.0730019
Jun 01 18:49:54.682507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Allocated IP 172.20.0.9 (4a9f474a-dc9d-475e-847d-0ea358045ed8/dead668a-1f23-483d-a130-8fd712cb633f/57350594-9e66-45d7-9d43-cd9828eb72bb) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:49:54.749573 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9574238d-f4b0-4761-9636-b94b772591af req-11c02ecf-db7d-4801-932b-544573d8401e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:54.751284 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9574238d-f4b0-4761-9636-b94b772591af req-11c02ecf-db7d-4801-932b-544573d8401e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1635799
Jun 01 18:49:54.862718 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9574238d-f4b0-4761-9636-b94b772591af req-fd9263d3-2df8-43e9-a7da-b83485182793 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0995934
Jun 01 18:49:55.054632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:55.073146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Transition to ACTIVE for port object 57350594-9e66-45d7-9d43-cd9828eb72bb will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:55.104142 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:55.110344 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:55.192448 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:49:55.195378 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:49:55.199746 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:49:55.240322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:55.396504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:55.456657 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:55.457291 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:55.497880 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5883434
Jun 01 18:49:55.526958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Request body: {'port': {'device_id': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:49:55.556165 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-9dfcd59c-8097-4106-88a0-15abc863ea8e None None] Provisioning for port 57350594-9e66-45d7-9d43-cd9828eb72bb completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:49:55.562390 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-9dfcd59c-8097-4106-88a0-15abc863ea8e None None] Provisioning complete for port 57350594-9e66-45d7-9d43-cd9828eb72bb triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:49:55.564917 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9dfcd59c-8097-4106-88a0-15abc863ea8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:55.607827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08bc9083-365a-4488-bccd-0765a29ad098 req-00918770-044b-4d26-8710-21ff279ae8ba tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:55.616605 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08bc9083-365a-4488-bccd-0765a29ad098 req-00918770-044b-4d26-8710-21ff279ae8ba tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1144280
Jun 01 18:49:55.671069 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08bc9083-365a-4488-bccd-0765a29ad098 req-1d5bce78-8baf-4b12-8209-523358ee5428 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0518701
Jun 01 18:49:55.732603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-9dfcd59c-8097-4106-88a0-15abc863ea8e None None] Port 57350594-9e66-45d7-9d43-cd9828eb72bb cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:49:55.847804 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:55.894879 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91bb6309-e302-409e-b838-2e4f7629bf94 req-7e296234-4abc-499f-b343-cf65bc33b1b3 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:55.897875 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-91bb6309-e302-409e-b838-2e4f7629bf94 req-7e296234-4abc-499f-b343-cf65bc33b1b3 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 931 time: 0.1175745
Jun 01 18:49:55.910248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f522fa41-3ffd-4fe6-851a-971788a30f0d req-d666c1e5-c05d-40c4-9af9-86db321e492d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:55.911879 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f522fa41-3ffd-4fe6-851a-971788a30f0d req-d666c1e5-c05d-40c4-9af9-86db321e492d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.3029428
Jun 01 18:49:55.975367 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-91bb6309-e302-409e-b838-2e4f7629bf94 req-375d25cb-4bde-4c45-9f5a-0a74a37ecc53 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0717402
Jun 01 18:49:56.029524 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f522fa41-3ffd-4fe6-851a-971788a30f0d req-5c5b9d6b-666b-4b63-95e4-3db90b3d298f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0900741
Jun 01 18:49:56.246683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705eb6da-b55e-4670-b194-333ba73ae79e req-56ef1b4f-43f5-4d44-9c14-d86604474693 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:56.257890 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-705eb6da-b55e-4670-b194-333ba73ae79e req-56ef1b4f-43f5-4d44-9c14-d86604474693 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1223886
Jun 01 18:49:56.318096 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-705eb6da-b55e-4670-b194-333ba73ae79e req-8d8399b8-586b-467b-94fa-f07132060862 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0588820
Jun 01 18:49:56.385284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 57350594-9e66-45d7-9d43-cd9828eb72bb {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:49:56.393466 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:56.408066 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Transition to ACTIVE for port object 57350594-9e66-45d7-9d43-cd9828eb72bb will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:49:56.412929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:56.416618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bc97ff11-11e8-4785-a804-773936806c0a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:56.579687 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:56.606996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:56.671009 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Attempting to bind port 57350594-9e66-45d7-9d43-cd9828eb72bb on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:49:56.671339 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Attempting to bind port 57350594-9e66-45d7-9d43-cd9828eb72bb by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:49:56.671663 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Attempting to bind port 57350594-9e66-45d7-9d43-cd9828eb72bb on network 4a9f474a-dc9d-475e-847d-0ea358045ed8 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:56.676887 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Port 57350594-9e66-45d7-9d43-cd9828eb72bb on network 4a9f474a-dc9d-475e-847d-0ea358045ed8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:49:56.677390 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Attempting to bind port 57350594-9e66-45d7-9d43-cd9828eb72bb on network 4a9f474a-dc9d-475e-847d-0ea358045ed8 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:49:56.683462 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 49, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:49:56.683799 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Checking segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:49:56.684173 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Bound using segment: {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:49:56.684632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Bound port: 57350594-9e66-45d7-9d43-cd9828eb72bb, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 67, 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:49:56.684975 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:56.803200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:49:56.806909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:49:56.813183 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:56.820100 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:49:56.880940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:56.880940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:49:56.880940 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] 10.222.0.25 "PUT /v2.0/ports/57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 1093 time: 1.3595629
Jun 01 18:49:56.881467 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:49:56.884025 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-439b310f-9d39-46c9-b9bc-c9078375081f" -d '{"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:49:56.913417 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:49:56.917772 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:49:56.950159 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f5370f3-8541-4f5c-b861-0d72dc5012d9 x-openstack-request-id: req-6f5370f3-8541-4f5c-b861-0d72dc5012d9 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:49:56.951749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:49:56.952253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-6f5370f3-8541-4f5c-b861-0d72dc5012d9 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:49:56.952921 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:49:57.103445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-f75c847f-8fb0-4388-8253-41f553a0fa79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.106663 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-f75c847f-8fb0-4388-8253-41f553a0fa79 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1096 time: 0.1275821
Jun 01 18:49:57.253504 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-18c7e5f3-7f59-4b5d-924a-6e67fc71a594 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 217 time: 0.1310813
Jun 01 18:49:57.316174 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba82710-fb5b-4d9d-9d1f-0040e1b91a95 req-fa0388bc-8fab-464e-9a85-cdeb4553057d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.317677 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9ba82710-fb5b-4d9d-9d1f-0040e1b91a95 req-fa0388bc-8fab-464e-9a85-cdeb4553057d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1482823
Jun 01 18:49:57.357354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-9f66065f-be44-4821-83f3-21dc3ce1995c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.358798 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-9f66065f-be44-4821-83f3-21dc3ce1995c service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.0838995
Jun 01 18:49:57.371275 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9ba82710-fb5b-4d9d-9d1f-0040e1b91a95 req-e2adb3cb-e256-46d6-8133-bec5a6c86c50 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471587
Jun 01 18:49:57.381040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef91414b-1d82-4f43-9f34-343faaeed01a req-cf9b432e-4619-485b-b8dc-e07ad533d175 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.382517 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ef91414b-1d82-4f43-9f34-343faaeed01a req-cf9b432e-4619-485b-b8dc-e07ad533d175 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1672802
Jun 01 18:49:57.482484 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ef91414b-1d82-4f43-9f34-343faaeed01a req-d36298ee-91cc-458e-bc6a-abe683080027 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0614011
Jun 01 18:49:57.522391 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-dec2c403-7235-4bed-ac30-cb561f836e8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.523963 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-dec2c403-7235-4bed-ac30-cb561f836e8d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1405804
Jun 01 18:49:57.651405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fe4f3f-86f7-4104-82cc-575f01fece71 req-10287e52-e2d6-45f3-8df5-ab3e960ece41 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:57.653318 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-09fe4f3f-86f7-4104-82cc-575f01fece71 req-10287e52-e2d6-45f3-8df5-ab3e960ece41 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1361513
Jun 01 18:49:57.710859 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-836be854-7951-478a-b40e-51ba4c1c7cb5 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1788630
Jun 01 18:49:57.724962 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-09fe4f3f-86f7-4104-82cc-575f01fece71 req-5fde5b1d-5638-442d-bbdc-62b12b5405bd tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0636015
Jun 01 18:49:57.972680 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2cbaf61-a374-43a1-b8e8-4bf09479ac0a req-8ac18511-7892-4f85-9758-ccafca6b5d77 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2373567
Jun 01 18:49:58.226811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439b310f-9d39-46c9-b9bc-c9078375081f req-d4cda1cf-ace2-406a-b6af-f16c1e002845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.229476 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-d4cda1cf-ace2-406a-b6af-f16c1e002845 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1096 time: 0.1689360
Jun 01 18:49:58.421209 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439b310f-9d39-46c9-b9bc-c9078375081f req-04e6dd3f-7326-471c-825f-03f8441d8140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.422632 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-04e6dd3f-7326-471c-825f-03f8441d8140 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.1797788
Jun 01 18:49:58.573977 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-fa10b26b-4e54-44ba-8ab8-db20ab90a6ac service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 217 time: 0.1358624
Jun 01 18:49:58.675672 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439b310f-9d39-46c9-b9bc-c9078375081f req-9f943bba-cc3e-4d10-9a18-37e5b4b3f8ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.677223 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-9f943bba-cc3e-4d10-9a18-37e5b4b3f8ba service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.0815499
Jun 01 18:49:58.691071 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-91dee621-0cce-40ea-a7e1-7a12c03332aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.691794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-91dee621-0cce-40ea-a7e1-7a12c03332aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:58.744742 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ec3ff5-2e5c-4ab2-8ad2-e1b812f29f12 req-8d8013f2-d8f7-4284-93cd-4ca7bc972204 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.746273 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8ec3ff5-2e5c-4ab2-8ad2-e1b812f29f12 req-8d8013f2-d8f7-4284-93cd-4ca7bc972204 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1089489
Jun 01 18:49:58.790662 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-91dee621-0cce-40ea-a7e1-7a12c03332aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:58.791883 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-91dee621-0cce-40ea-a7e1-7a12c03332aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.2707574
Jun 01 18:49:58.816689 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8ec3ff5-2e5c-4ab2-8ad2-e1b812f29f12 req-b086e07b-c343-4f4c-9d0b-4ad3da4f19eb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0639439
Jun 01 18:49:58.868195 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439b310f-9d39-46c9-b9bc-c9078375081f req-1d9ec596-e6cf-471e-b48a-af50223a3383 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:58.870350 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-1d9ec596-e6cf-471e-b48a-af50223a3383 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1756127
Jun 01 18:49:58.884460 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-2fa47b5a-2308-479d-9ddd-908ffa51e365 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:49:59.003475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-2fa47b5a-2308-479d-9ddd-908ffa51e365 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:49:59.004568 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3800325d-5ea0-4aac-a90b-8d3772018b54 req-2fa47b5a-2308-479d-9ddd-908ffa51e365 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2047372
Jun 01 18:49:59.064947 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-d23d0f87-3654-49d2-b84a-93980e661504 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1776006
Jun 01 18:49:59.345289 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-439b310f-9d39-46c9-b9bc-c9078375081f req-2773ac56-eb12-4e26-9f07-d9744c4ef923 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2609024
Jun 01 18:49:59.375347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fcc17e4-dfe2-4e81-92b4-5e5bab8e63fa req-62942dea-f6c9-45df-ba3c-56f805462fc4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:49:59.381464 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5fcc17e4-dfe2-4e81-92b4-5e5bab8e63fa req-62942dea-f6c9-45df-ba3c-56f805462fc4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2251637
Jun 01 18:49:59.438492 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5fcc17e4-dfe2-4e81-92b4-5e5bab8e63fa req-e2b0faf3-e67e-4c7a-ac46-b171ab3ae9fc tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0541914
Jun 01 18:50:00.042344 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59f68dd-95d3-49be-a879-29f6e2d7bc70 req-9fed14fb-a0e1-492a-b74d-068a433d954a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:00.043888 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e59f68dd-95d3-49be-a879-29f6e2d7bc70 req-9fed14fb-a0e1-492a-b74d-068a433d954a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1026912
Jun 01 18:50:00.101368 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e59f68dd-95d3-49be-a879-29f6e2d7bc70 req-09f2862b-9b76-4fbf-946e-6a550a5a6b80 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505903
Jun 01 18:50:00.249712 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17fc40e-4942-4315-8e86-c745d87617d7 req-9b2fa5e7-cf8e-4b1d-a5e3-62ff9d9d2ae8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:00.251184 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d17fc40e-4942-4315-8e86-c745d87617d7 req-9b2fa5e7-cf8e-4b1d-a5e3-62ff9d9d2ae8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1172798
Jun 01 18:50:00.313065 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d17fc40e-4942-4315-8e86-c745d87617d7 req-68dc2017-be28-463f-95fc-05202f5369ff tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528798
Jun 01 18:50:00.966871 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e76751-d139-4e06-b447-6ee074526b77 req-92224332-aee5-4fbc-808e-4acc47300672 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:00.982650 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-37e76751-d139-4e06-b447-6ee074526b77 req-92224332-aee5-4fbc-808e-4acc47300672 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.2169397
Jun 01 18:50:01.129456 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-37e76751-d139-4e06-b447-6ee074526b77 req-326db96b-6749-46e7-8287-1bda1a9a4b83 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1141505
Jun 01 18:50:01.430226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5459fa09-3d03-47fa-8f07-b7fd1593ba1e req-ec8f97be-0b3a-4a56-8625-5d4dac7725dd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:01.431859 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5459fa09-3d03-47fa-8f07-b7fd1593ba1e req-ec8f97be-0b3a-4a56-8625-5d4dac7725dd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1532521
Jun 01 18:50:01.527350 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5459fa09-3d03-47fa-8f07-b7fd1593ba1e req-ab91e547-8f8d-4d94-8a68-9199e14bbae9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0872810
Jun 01 18:50:01.543841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3cf9e6-1938-4ff3-a1e1-aab50567fa57 req-ef000642-1a03-4967-8af6-0a8f10f1a047 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:01.543841 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5c3cf9e6-1938-4ff3-a1e1-aab50567fa57 req-ef000642-1a03-4967-8af6-0a8f10f1a047 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1178215
Jun 01 18:50:01.601440 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5c3cf9e6-1938-4ff3-a1e1-aab50567fa57 req-230fdc09-70cd-400d-816d-57d90da0a799 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0503738
Jun 01 18:50:02.302606 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44526f51-eca9-49da-97b8-b669975a26a5 req-2264f5c4-e96f-41b2-85a4-e47258fc86eb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:02.309802 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-44526f51-eca9-49da-97b8-b669975a26a5 req-2264f5c4-e96f-41b2-85a4-e47258fc86eb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1027951
Jun 01 18:50:02.368048 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-44526f51-eca9-49da-97b8-b669975a26a5 req-e653008f-376f-43fe-84bb-f8b17e716b82 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573857
Jun 01 18:50:02.781117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bee133a-a1a6-47e7-9244-844522f97d98 req-4a73cf49-3a47-4dcd-be33-c0a39f196fd9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:02.782602 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8bee133a-a1a6-47e7-9244-844522f97d98 req-4a73cf49-3a47-4dcd-be33-c0a39f196fd9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1265140
Jun 01 18:50:02.822616 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1f9dbe-8378-4796-9370-82c7dab1edbd req-447dfc4b-c7b3-4517-be9b-ca55d654785f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:02.825273 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4e1f9dbe-8378-4796-9370-82c7dab1edbd req-447dfc4b-c7b3-4517-be9b-ca55d654785f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0921535
Jun 01 18:50:02.833988 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8bee133a-a1a6-47e7-9244-844522f97d98 req-3e3e3e80-ec78-462d-a4db-d87366ddf24a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445168
Jun 01 18:50:02.873749 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4e1f9dbe-8378-4796-9370-82c7dab1edbd req-4610c07c-16a4-4541-aed1-00cd3d0f4567 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411923
Jun 01 18:50:03.370233 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5c3e03-bb74-45f0-9b03-ee9fc5cc7c9f req-2946b798-d194-4a22-8994-b4ec18c0b210 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:03.371697 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb5c3e03-bb74-45f0-9b03-ee9fc5cc7c9f req-2946b798-d194-4a22-8994-b4ec18c0b210 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0835745
Jun 01 18:50:03.425481 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bb5c3e03-bb74-45f0-9b03-ee9fc5cc7c9f req-52018b8d-144f-4fd8-afcf-6db37a541696 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0477214
Jun 01 18:50:03.566543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cadb87-c644-4d3c-9749-06e0b9028ed6 req-bacd9901-d511-436c-b268-9e298f91ff81 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:03.567996 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-77cadb87-c644-4d3c-9749-06e0b9028ed6 req-bacd9901-d511-436c-b268-9e298f91ff81 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0831161
Jun 01 18:50:03.614320 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-77cadb87-c644-4d3c-9749-06e0b9028ed6 req-24b25f75-fbb4-487d-9f20-4d4a0eb4d08f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392866
Jun 01 18:50:04.046360 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e65bbf-a8a8-4926-8b61-983f7ed27d9f req-cf93e3cc-45b7-4d7f-be88-3ebf21788a2b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:04.047811 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-41e65bbf-a8a8-4926-8b61-983f7ed27d9f req-cf93e3cc-45b7-4d7f-be88-3ebf21788a2b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0966704
Jun 01 18:50:04.067575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26b264e-12c7-4f2a-8312-c80f5301beb8 req-c5e3129c-846d-4508-b558-0800971018d4 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:04.069079 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f26b264e-12c7-4f2a-8312-c80f5301beb8 req-c5e3129c-846d-4508-b558-0800971018d4 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0916703
Jun 01 18:50:04.092881 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-41e65bbf-a8a8-4926-8b61-983f7ed27d9f req-804f2d7e-0c9e-464e-8b70-f08640601f23 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391240
Jun 01 18:50:04.177712 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f26b264e-12c7-4f2a-8312-c80f5301beb8 req-a35e5cfa-0dea-4402-b379-48ff54467a33 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1031175
Jun 01 18:50:04.228922 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:50:04.617891 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd305615-7b39-425b-a08b-27a7a82a5518 req-c59d3aaf-8956-4b24-b4a4-fa45c012a503 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:04.619500 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dd305615-7b39-425b-a08b-27a7a82a5518 req-c59d3aaf-8956-4b24-b4a4-fa45c012a503 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0825303
Jun 01 18:50:04.684991 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dd305615-7b39-425b-a08b-27a7a82a5518 req-183b3734-03e2-4f1e-86fd-ef7e26ef8121 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0591638
Jun 01 18:50:04.808078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855a7d55-1a89-4428-9919-5b9d77ab16d2 req-d0f3d1c5-1a5c-483b-b01f-ff8515041ee0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:04.809596 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-855a7d55-1a89-4428-9919-5b9d77ab16d2 req-d0f3d1c5-1a5c-483b-b01f-ff8515041ee0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0813849
Jun 01 18:50:04.857124 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-855a7d55-1a89-4428-9919-5b9d77ab16d2 req-816f2eaf-5071-4a27-9473-b549620f7f6c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417647
Jun 01 18:50:05.352903 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e70ee3-cff9-47ac-a933-3585a19702f5 req-d609da3e-5367-4635-af42-62b0f6071f20 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:05.354378 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e7e70ee3-cff9-47ac-a933-3585a19702f5 req-d609da3e-5367-4635-af42-62b0f6071f20 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1497352
Jun 01 18:50:05.387993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406383af-0894-4459-bb2e-589bec46b41b req-c6640828-2c08-435e-8c67-918027a8c727 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:05.389536 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-406383af-0894-4459-bb2e-589bec46b41b req-c6640828-2c08-435e-8c67-918027a8c727 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1006525
Jun 01 18:50:05.400195 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e7e70ee3-cff9-47ac-a933-3585a19702f5 req-b966d16b-06da-48b1-b1de-840d16efee83 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398002
Jun 01 18:50:05.437010 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-406383af-0894-4459-bb2e-589bec46b41b req-9d3d8327-d3a1-4641-831d-da4dfec00516 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413408
Jun 01 18:50:05.877044 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78b5036-faae-4104-a84b-3e5fd5861a04 req-9f1ad6bb-be62-4363-8f62-912671fd7b44 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:05.884472 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b78b5036-faae-4104-a84b-3e5fd5861a04 req-9f1ad6bb-be62-4363-8f62-912671fd7b44 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0882516
Jun 01 18:50:05.925826 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b78b5036-faae-4104-a84b-3e5fd5861a04 req-f8611b0c-15b0-4691-8a7e-b35a98c3bf4b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404840
Jun 01 18:50:06.050000 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6cadde-9491-4ad9-9afb-6a3161fa0bb8 req-9f5269d2-c793-4cbf-8da7-27ce62dcd742 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:06.051463 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-df6cadde-9491-4ad9-9afb-6a3161fa0bb8 req-9f5269d2-c793-4cbf-8da7-27ce62dcd742 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0874429
Jun 01 18:50:06.094401 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-df6cadde-9491-4ad9-9afb-6a3161fa0bb8 req-3ee0ef47-b335-440e-9a29-6813c1f45ae9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373871
Jun 01 18:50:06.596385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90a12a1-6433-45a5-a7fd-1909abaa242d req-a86bcf11-a254-40bb-8a65-9a8b095dc4bb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:06.598199 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e90a12a1-6433-45a5-a7fd-1909abaa242d req-a86bcf11-a254-40bb-8a65-9a8b095dc4bb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0840244
Jun 01 18:50:06.640335 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b657205-880c-46f6-8842-dff4bfa81f84 req-8bbe4c42-cdf8-4ac5-9f6f-23f1ef221b8a tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:06.641869 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8b657205-880c-46f6-8842-dff4bfa81f84 req-8bbe4c42-cdf8-4ac5-9f6f-23f1ef221b8a tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0838828
Jun 01 18:50:06.656650 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e90a12a1-6433-45a5-a7fd-1909abaa242d req-846deaba-fc87-49a6-8006-50e778d2d1a7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0525610
Jun 01 18:50:06.694776 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8b657205-880c-46f6-8842-dff4bfa81f84 req-6fa95657-edb1-4010-87db-bcac944a82ce tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399480
Jun 01 18:50:07.110183 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae733190-059e-4e0b-98e8-f61fed4fa78c req-96a8d0fc-7682-4dea-a286-5687bfb67d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:07.111821 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ae733190-059e-4e0b-98e8-f61fed4fa78c req-96a8d0fc-7682-4dea-a286-5687bfb67d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0792348
Jun 01 18:50:07.169779 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ae733190-059e-4e0b-98e8-f61fed4fa78c req-a98efe26-83de-4365-8dec-4023de64d229 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442350
Jun 01 18:50:07.302638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcb12c2-e269-482a-acd5-0b0350251934 req-a66a263b-90a0-4039-b781-d37d4bc9447d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:07.304239 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-abcb12c2-e269-482a-acd5-0b0350251934 req-a66a263b-90a0-4039-b781-d37d4bc9447d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0852673
Jun 01 18:50:07.350773 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-abcb12c2-e269-482a-acd5-0b0350251934 req-8195389e-0ea3-463a-90e6-5b094c15e007 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400541
Jun 01 18:50:07.862004 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d0b859-64b9-477e-a5cc-d2af3977c3a6 req-3216ded7-45ef-41d1-9c4b-8beddc756ea3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:07.863523 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-77d0b859-64b9-477e-a5cc-d2af3977c3a6 req-3216ded7-45ef-41d1-9c4b-8beddc756ea3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0857127
Jun 01 18:50:07.928386 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-77d0b859-64b9-477e-a5cc-d2af3977c3a6 req-96242d62-d236-4919-96e9-f2a9d92e4de2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0590415
Jun 01 18:50:07.936098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfe25da-8a8d-48d8-b3be-97dcfa11f536 req-6899d7d7-972b-4c54-b116-0c27d1756247 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:07.938041 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9cfe25da-8a8d-48d8-b3be-97dcfa11f536 req-6899d7d7-972b-4c54-b116-0c27d1756247 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1140394
Jun 01 18:50:07.989310 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9cfe25da-8a8d-48d8-b3be-97dcfa11f536 req-597fea5b-cfd9-4f97-9c07-b14bcd515abe tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457637
Jun 01 18:50:08.388411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875f4ae1-6128-46d3-8fa3-ab613e16e5c0 req-8fdbea8a-949f-4171-bc2d-108054126e5d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:08.390041 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-875f4ae1-6128-46d3-8fa3-ab613e16e5c0 req-8fdbea8a-949f-4171-bc2d-108054126e5d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.1047733
Jun 01 18:50:08.448094 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-875f4ae1-6128-46d3-8fa3-ab613e16e5c0 req-2a436f15-49a8-478c-90fb-d0ece3007e29 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513678
Jun 01 18:50:08.576620 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4194094-e561-40ec-96a5-5b0f3ff56fc9 req-63904fff-b209-4883-b8b5-f78c9dfad553 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:08.578086 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d4194094-e561-40ec-96a5-5b0f3ff56fc9 req-63904fff-b209-4883-b8b5-f78c9dfad553 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0962033
Jun 01 18:50:08.623642 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d4194094-e561-40ec-96a5-5b0f3ff56fc9 req-c3f3574e-9f61-4985-a5ff-415ec094f3a2 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392787
Jun 01 18:50:09.056897 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:09.140983 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bceb5d1b-2644-4dc6-9fb8-ecf478aa4548 req-8bfaff27-6db7-4bf7-ad92-912992f552a3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:09.142928 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bceb5d1b-2644-4dc6-9fb8-ecf478aa4548 req-8bfaff27-6db7-4bf7-ad92-912992f552a3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.1013119
Jun 01 18:50:09.186851 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bceb5d1b-2644-4dc6-9fb8-ecf478aa4548 req-fe62ed84-2d47-4d52-ac0e-fd6a5d86b204 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379422
Jun 01 18:50:09.202495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f76c652-c1c9-4109-8512-377281f5e345 req-be9c888b-171c-4dee-a682-99953a9fea72 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:09.203945 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f76c652-c1c9-4109-8512-377281f5e345 req-be9c888b-171c-4dee-a682-99953a9fea72 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0797250
Jun 01 18:50:09.261798 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f76c652-c1c9-4109-8512-377281f5e345 req-061489cd-39f6-417f-8c27-957932281d83 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514219
Jun 01 18:50:09.632895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a03919d-2822-4648-a863-97f435ae59d1 req-ed2a095f-3109-4188-9b4d-96394f8dd21c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:09.634312 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7a03919d-2822-4648-a863-97f435ae59d1 req-ed2a095f-3109-4188-9b4d-96394f8dd21c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0788527
Jun 01 18:50:09.687675 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7a03919d-2822-4648-a863-97f435ae59d1 req-41ea6955-a9a0-4284-a5b5-1532a7552ae8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455670
Jun 01 18:50:09.813150 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338d3a7c-683c-4612-9dfa-4d0475e056e8 req-a0a071a9-697b-4b6d-942b-323e3bc53444 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:09.815219 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-338d3a7c-683c-4612-9dfa-4d0475e056e8 req-a0a071a9-697b-4b6d-942b-323e3bc53444 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0806458
Jun 01 18:50:09.858817 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-338d3a7c-683c-4612-9dfa-4d0475e056e8 req-72343381-8525-41ef-b4e4-81aeeb45ec83 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380554
Jun 01 18:50:10.383542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5144ea-5344-45cd-a17d-53137e493f41 req-a23233a0-63b7-47bd-af5e-ec2b0c3630a8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:10.385020 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1e5144ea-5344-45cd-a17d-53137e493f41 req-a23233a0-63b7-47bd-af5e-ec2b0c3630a8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0815432
Jun 01 18:50:10.444338 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1e5144ea-5344-45cd-a17d-53137e493f41 req-c4330add-06cd-42ef-9cc2-dacfe2af970c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515852
Jun 01 18:50:10.465198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b7df1a-904d-439d-8911-6ebf6812a72a req-67035c5b-5858-4dd0-8857-dda81dd1e6ce tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:10.466673 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2b7df1a-904d-439d-8911-6ebf6812a72a req-67035c5b-5858-4dd0-8857-dda81dd1e6ce tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0963614
Jun 01 18:50:10.512741 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2b7df1a-904d-439d-8911-6ebf6812a72a req-645e8d4a-471e-4de0-94d0-caa5baaa65f2 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392289
Jun 01 18:50:10.890712 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be4b194a-ceb5-40a5-b314-ee5f679f6d28 req-34bb4287-a140-4789-b68e-37e9ef5954c4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:10.892321 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-be4b194a-ceb5-40a5-b314-ee5f679f6d28 req-34bb4287-a140-4789-b68e-37e9ef5954c4 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0892260
Jun 01 18:50:10.938519 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-be4b194a-ceb5-40a5-b314-ee5f679f6d28 req-6a9d6daa-8710-4656-83a6-3fe3e495565d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403461
Jun 01 18:50:11.070776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ec7410-5d89-43fe-a439-61c4996c2d47 req-6eb14728-ddcb-416f-a86a-aa364a930029 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:11.072147 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-04ec7410-5d89-43fe-a439-61c4996c2d47 req-6eb14728-ddcb-416f-a86a-aa364a930029 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0817409
Jun 01 18:50:11.115663 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-04ec7410-5d89-43fe-a439-61c4996c2d47 req-656feb77-837e-4dca-8fda-0d67d8d502aa tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377119
Jun 01 18:50:11.646930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484f86c3-1bae-47e5-9c6a-e46d78000d8a req-c3b98395-bcb4-415c-a686-53c1ac4584c5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:11.648869 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-484f86c3-1bae-47e5-9c6a-e46d78000d8a req-c3b98395-bcb4-415c-a686-53c1ac4584c5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0888617
Jun 01 18:50:11.710157 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-484f86c3-1bae-47e5-9c6a-e46d78000d8a req-3bb70519-205c-4b16-861b-556d6d8026e8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0552189
Jun 01 18:50:11.725625 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff238c6-5b52-45bd-aba8-0b608e550aa2 req-cde3ef6f-c1b9-4e7c-83fa-efdd8c9993de tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:11.727132 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bff238c6-5b52-45bd-aba8-0b608e550aa2 req-cde3ef6f-c1b9-4e7c-83fa-efdd8c9993de tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0976295
Jun 01 18:50:11.772891 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bff238c6-5b52-45bd-aba8-0b608e550aa2 req-52bc48c5-ef10-48e6-bb91-42e5e9d386cd tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399499
Jun 01 18:50:12.130411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b7bf63-dc6c-49ab-9533-0bf887f4f33c req-9d13770c-0c00-4628-ab1b-807cdd14290a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:12.132165 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-56b7bf63-dc6c-49ab-9533-0bf887f4f33c req-9d13770c-0c00-4628-ab1b-807cdd14290a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0825706
Jun 01 18:50:12.179674 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-56b7bf63-dc6c-49ab-9533-0bf887f4f33c req-f29af75e-21e3-496e-a165-6fc78eb14e9c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416348
Jun 01 18:50:12.301270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9142f22c-aac5-4edc-baab-1c1ec69f9117 req-c1456cfa-7845-40a6-801a-bba684c116cf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:12.302681 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9142f22c-aac5-4edc-baab-1c1ec69f9117 req-c1456cfa-7845-40a6-801a-bba684c116cf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0799387
Jun 01 18:50:12.356512 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9142f22c-aac5-4edc-baab-1c1ec69f9117 req-54c6633a-8060-4608-afd2-de3da7d380dc tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480671
Jun 01 18:50:13.008989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4adfd4d3-281c-4158-9411-eb894e229042 req-c9b9a02f-90d8-42d9-8975-3e3f5c58af20 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:13.011432 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4adfd4d3-281c-4158-9411-eb894e229042 req-c9b9a02f-90d8-42d9-8975-3e3f5c58af20 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1279316
Jun 01 18:50:13.060140 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4adfd4d3-281c-4158-9411-eb894e229042 req-6fdfc388-4c2d-4d05-afbe-1b50710ede60 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430570
Jun 01 18:50:13.101097 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bed7e590-9a4a-46ef-89b0-382483f02b8b req-5f5569d0-841e-47e2-bf34-d12022a7ca14 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:13.102602 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bed7e590-9a4a-46ef-89b0-382483f02b8b req-5f5569d0-841e-47e2-bf34-d12022a7ca14 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0792572
Jun 01 18:50:13.147863 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bed7e590-9a4a-46ef-89b0-382483f02b8b req-c43eb0cc-eb08-40b8-a5c6-981a1945a7fa tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394621
Jun 01 18:50:13.365494 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92a1cd2-cbca-42bb-880b-d3346a5409be req-5a01780a-5b8b-4370-9c4c-0a572d3c7484 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:13.366337 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d92a1cd2-cbca-42bb-880b-d3346a5409be req-5a01780a-5b8b-4370-9c4c-0a572d3c7484 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0839808
Jun 01 18:50:13.413825 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d92a1cd2-cbca-42bb-880b-d3346a5409be req-e7d17ce8-1c94-491f-bcf0-4ca4cb401060 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411167
Jun 01 18:50:13.556157 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e25a439-9d20-4502-9e84-31d28e15340c req-1a7ff36c-c813-4a54-b023-d63f9a649871 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:13.557617 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e25a439-9d20-4502-9e84-31d28e15340c req-1a7ff36c-c813-4a54-b023-d63f9a649871 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0843930
Jun 01 18:50:13.601777 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0e25a439-9d20-4502-9e84-31d28e15340c req-f9942918-5181-4707-998a-7ed5e15add2c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383096
Jun 01 18:50:13.952968 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36390) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:14.074849 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.091598 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:14.095533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Usage tracker for resource:security_group_rule and tenant:6953dd9d5eb646eaa98c474fe762d4de is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:14.098447 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:14.104221 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:14.121414 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b0bc3217-19fb-4a6a-b44c-32baf8921219 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.253093 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.266485 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.284128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:14.340838 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=6953dd9d5eb646eaa98c474fe762d4de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3865595
Jun 01 18:50:14.342868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36398) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:14.347483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94125152-dce3-4675-9efb-f0a3f701bb24 req-f2a0fc3d-6c51-474c-8e41-e3550a39297e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:14.348989 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-94125152-dce3-4675-9efb-f0a3f701bb24 req-f2a0fc3d-6c51-474c-8e41-e3550a39297e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0862904
Jun 01 18:50:14.354527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=868aa168-cb27-4585-ba26-4dc07f2f6680,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:14.363444 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347f90a2-d604-4cf6-9114-11bcbb1c0139 req-f0e61e1e-3644-43d0-8800-f651e783f26b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:14.364936 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-347f90a2-d604-4cf6-9114-11bcbb1c0139 req-f0e61e1e-3644-43d0-8800-f651e783f26b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1876574
Jun 01 18:50:14.377614 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.378003 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.378345 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.378706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.379059 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.379418 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.379768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.380116 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.380491 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.380839 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.381187 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.381529 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:14.397933 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-94125152-dce3-4675-9efb-f0a3f701bb24 req-5624459f-5488-4bf1-86d3-50424ff8293a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426142
Jun 01 18:50:14.416118 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:14.463212 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-347f90a2-d604-4cf6-9114-11bcbb1c0139 req-3fd0f91e-ca08-47aa-ae93-8085c9b5e7f8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0924945
Jun 01 18:50:14.469908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.497616 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.569074 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.574432 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:14.589583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=868aa168-cb27-4585-ba26-4dc07f2f6680,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:14.592542 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:14.594358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:14.598324 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/868aa168-cb27-4585-ba26-4dc07f2f6680 HTTP/1.1" status: 204  len: 168 time: 0.2516811
Jun 01 18:50:14.601386 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afaf6744-2632-4f67-8cce-163ee29325ee req-e676b7dd-e131-4f32-890c-9e07abb59c65 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:14.602855 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-afaf6744-2632-4f67-8cce-163ee29325ee req-e676b7dd-e131-4f32-890c-9e07abb59c65 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0812268
Jun 01 18:50:14.676482 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-afaf6744-2632-4f67-8cce-163ee29325ee req-92054b40-7c0e-483e-ad7a-af565ac5372f tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0623832
Jun 01 18:50:14.913391 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c39bdf-1b61-48dd-9e07-e970da8e559b req-94628b72-c1fb-4fbb-aed7-4a48101d2b86 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:14.915044 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d9c39bdf-1b61-48dd-9e07-e970da8e559b req-94628b72-c1fb-4fbb-aed7-4a48101d2b86 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1807704
Jun 01 18:50:14.979713 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d9c39bdf-1b61-48dd-9e07-e970da8e559b req-f62a52dd-66fd-4b9a-bfbc-b2e6a947f898 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0589452
Jun 01 18:50:15.605098 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bb76a6-162f-4657-8ef1-0c5ac1827d43 req-c1cd0cfb-2b02-42e9-a635-3775ee2349c9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:15.606534 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-22bb76a6-162f-4657-8ef1-0c5ac1827d43 req-c1cd0cfb-2b02-42e9-a635-3775ee2349c9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0912120
Jun 01 18:50:15.655227 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-22bb76a6-162f-4657-8ef1-0c5ac1827d43 req-381344f5-a96d-4f5f-949c-1b71847091f8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429232
Jun 01 18:50:15.687354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71cea55-c6bc-44d1-90b8-27feecdb4706 req-1c48e77f-f01a-4eb8-b904-8539a8319630 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:15.688849 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f71cea55-c6bc-44d1-90b8-27feecdb4706 req-1c48e77f-f01a-4eb8-b904-8539a8319630 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0941665
Jun 01 18:50:15.740066 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f71cea55-c6bc-44d1-90b8-27feecdb4706 req-f9fa70ce-af92-4b57-b1b2-ecc15fe098d6 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447259
Jun 01 18:50:15.809621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36444) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:15.870811 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9802e0-6de1-438c-933c-338e9ed0c4e3 req-7f00cff6-a89c-4cfe-a433-5316233a1bf5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:15.872246 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2c9802e0-6de1-438c-933c-338e9ed0c4e3 req-7f00cff6-a89c-4cfe-a433-5316233a1bf5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0818508
Jun 01 18:50:15.916865 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2c9802e0-6de1-438c-933c-338e9ed0c4e3 req-a0d0a103-cc4b-4352-9ad0-f9ea2e7ff03e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388911
Jun 01 18:50:15.926705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:15.941030 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:15.944847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Usage tracker for resource:security_group_rule and tenant:f83786b16b6e4938a73e8c0ca73afecf is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:15.947620 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:15.953261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:16.036630 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.041448 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.049884 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6b0d1b4b-feb1-4053-a4f5-d3f8d36ad502 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:16.126406 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=f83786b16b6e4938a73e8c0ca73afecf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3155854
Jun 01 18:50:16.127107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52265436-e7ea-4acd-9254-9a1c1859c882,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:16.128984 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 36450) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:16.134328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:16.193573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a70db4-cde1-4ea4-8b1b-c97218eb9d29 req-51f1fa6e-71bb-47e9-b774-6f9786c505df tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:16.195183 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-45a70db4-cde1-4ea4-8b1b-c97218eb9d29 req-51f1fa6e-71bb-47e9-b774-6f9786c505df tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1056616
Jun 01 18:50:16.256567 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-45a70db4-cde1-4ea4-8b1b-c97218eb9d29 req-1e29afa3-eaff-49e4-9a3e-e12b6a5c7058 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451994
Jun 01 18:50:16.275111 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.300621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.350112 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.356229 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a027d614-c8b2-4d08-a82e-328ddb6dc5b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:16.369246 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52265436-e7ea-4acd-9254-9a1c1859c882,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:16.376393 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.377571 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/52265436-e7ea-4acd-9254-9a1c1859c882 HTTP/1.1" status: 204  len: 168 time: 0.2472627
Jun 01 18:50:16.378923 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.379278 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.379630 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.379978 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.380320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.380700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.381052 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.381754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.381754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.382026 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.382358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.382735 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:16.385786 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:16.703052 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-2c4ebc57-3fc8-4e0c-a4d4-c52485bf0da8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.858036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef1eeab-e5de-4229-b77e-b610e1a1eafe req-2314f488-3980-439f-9c2f-b146cfa00b09 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:16.858572 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:16.859580 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4ef1eeab-e5de-4229-b77e-b610e1a1eafe req-2314f488-3980-439f-9c2f-b146cfa00b09 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0852418
Jun 01 18:50:16.908494 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4ef1eeab-e5de-4229-b77e-b610e1a1eafe req-eefe07f7-fd25-4dee-b2cb-5255c1420ef4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421565
Jun 01 18:50:16.977497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28ace23-385d-4984-9c6d-000a0ae8a1e0 req-0aea50b3-2b37-482a-9355-30ef14b9d897 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:16.979301 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b28ace23-385d-4984-9c6d-000a0ae8a1e0 req-0aea50b3-2b37-482a-9355-30ef14b9d897 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1215074
Jun 01 18:50:17.002259 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-cdf29def-c07d-43b3-b17e-236ad10c309b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.004083 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-cdf29def-c07d-43b3-b17e-236ad10c309b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1098 time: 0.0803967
Jun 01 18:50:17.041805 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b28ace23-385d-4984-9c6d-000a0ae8a1e0 req-2c7776d5-57b6-403d-9eb8-07d5a58d9d55 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515237
Jun 01 18:50:17.209635 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-51e0de3b-1d94-48f4-ab1d-d70541c69f68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.211064 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-51e0de3b-1d94-48f4-ab1d-d70541c69f68 service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.1948254
Jun 01 18:50:17.221138 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf95eddb-2e07-4028-ab43-7b1a2075772c req-79ad40c2-7951-413f-9458-3d68935457f5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.222495 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cf95eddb-2e07-4028-ab43-7b1a2075772c req-79ad40c2-7951-413f-9458-3d68935457f5 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.1747696
Jun 01 18:50:17.346833 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cf95eddb-2e07-4028-ab43-7b1a2075772c req-18b77be0-02f6-4c71-a0c9-3a0b336158bd tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0772412
Jun 01 18:50:17.350485 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-c8cf0e97-0030-42bc-b695-ad8e64e0e4c0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 1000 time: 0.1270959
Jun 01 18:50:17.419183 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-4a5fe3a6-e16e-4dfc-bde7-2d3b5106c49e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.420655 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-4a5fe3a6-e16e-4dfc-bde7-2d3b5106c49e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.0597303
Jun 01 18:50:17.453687 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bfd3fd-cf2f-4021-ad57-8d9430ef1cd0 req-b1b8e137-9d2d-41cf-b80f-ae030bacd0bf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.461410 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-37bfd3fd-cf2f-4021-ad57-8d9430ef1cd0 req-b1b8e137-9d2d-41cf-b80f-ae030bacd0bf tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0903814
Jun 01 18:50:17.510894 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-78667c30-b1a8-48e1-9bac-b68918a7f8d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:17.512599 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-78667c30-b1a8-48e1-9bac-b68918a7f8d5 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0779655
Jun 01 18:50:17.516916 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-37bfd3fd-cf2f-4021-ad57-8d9430ef1cd0 req-92c455c5-0249-40e6-813b-4739f5345573 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0545759
Jun 01 18:50:17.656856 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-ed1df154-50d8-4027-a0a4-a697e4c9d669 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1342559
Jun 01 18:50:17.793186 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:17.799653 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1a5143a0-a16d-4326-9e9f-a76443385ef4 req-29c91d96-f6fe-4b56-8b55-7d3fdfd25f80 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1320848
Jun 01 18:50:18.098309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3fe624-fe0d-40d9-b0f5-b1023aa63f42 req-1a83e58c-5636-4f1c-a2ac-e842debecefd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:18.099759 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bd3fe624-fe0d-40d9-b0f5-b1023aa63f42 req-1a83e58c-5636-4f1c-a2ac-e842debecefd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.0801029
Jun 01 18:50:18.144056 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bd3fe624-fe0d-40d9-b0f5-b1023aa63f42 req-cefca7a8-5102-417c-ae77-bef6a63625a4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383351
Jun 01 18:50:18.214682 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff6fca2-351b-4a2f-bb57-b412db1a3f83 req-8d8b4265-f37a-40ae-8fac-5f920d8b9a5b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:18.216109 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3ff6fca2-351b-4a2f-bb57-b412db1a3f83 req-8d8b4265-f37a-40ae-8fac-5f920d8b9a5b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.0834038
Jun 01 18:50:18.259746 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3ff6fca2-351b-4a2f-bb57-b412db1a3f83 req-366888a5-26c0-488c-a1fd-3ee0d17c5624 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373886
Jun 01 18:50:18.530632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ac9fb2-0574-49e8-90d3-b8e91b482146 req-aed250c1-3e96-48e5-956c-7babadac8554 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:18.532075 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-33ac9fb2-0574-49e8-90d3-b8e91b482146 req-aed250c1-3e96-48e5-956c-7babadac8554 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0813999
Jun 01 18:50:18.575098 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-33ac9fb2-0574-49e8-90d3-b8e91b482146 req-fc3b9d65-3585-46dd-8f33-eae5fb7387ac tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374594
Jun 01 18:50:18.696141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725d304e-01f8-43ac-87d3-57e5b924e265 req-dc4a77c3-00a0-4a19-9159-57bdcb75aa23 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:18.697637 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-725d304e-01f8-43ac-87d3-57e5b924e265 req-dc4a77c3-00a0-4a19-9159-57bdcb75aa23 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0806837
Jun 01 18:50:18.738189 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-2a5fe7bd-4f2e-480b-ad15-f767657df8ee tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:18.739623 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-2a5fe7bd-4f2e-480b-ad15-f767657df8ee tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 946 time: 0.0793881
Jun 01 18:50:18.743169 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-725d304e-01f8-43ac-87d3-57e5b924e265 req-c42aed52-ef36-4f46-adb0-f14e578e82fa tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398860
Jun 01 18:50:18.885688 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Deleting port 69b10932-a965-4259-8f8c-39d6322653b1 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:50:18.886034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.018217 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] For port 69b10932-a965-4259-8f8c-39d6322653b1, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=69b10932-a965-4259-8f8c-39d6322653b1,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:19.018581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.209947 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 57350594-9e66-45d7-9d43-cd9828eb72bb details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:50:19.212730 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:19.216151 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Calling delete_port for 69b10932-a965-4259-8f8c-39d6322653b1 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:50:19.389319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.400320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-de2d5d91-a4ea-4806-a0b2-7f237e5fb73d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:19.413989 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256', '00a066ed-ad86-4d31-9083-bf2f681a2c2c', '4878da57-0d45-4191-82df-acc476090da6', '69b10932-a965-4259-8f8c-39d6322653b1'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:19.455863 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event deleted for resources: {'Port': ['ID=69b10932-a965-4259-8f8c-39d6322653b1,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:19.487290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632fc9e0-4c9b-479b-9886-3a2c43639940 req-4f44a26b-99cc-448d-b7ce-743d396b5019 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:19.490303 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:19.495971 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-632fc9e0-4c9b-479b-9886-3a2c43639940 req-4f44a26b-99cc-448d-b7ce-743d396b5019 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 943 time: 0.1009529
Jun 01 18:50:19.537105 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] No DVR routers for this DVR port 69b10932-a965-4259-8f8c-39d6322653b1 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:50:19.542653 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.543217 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-632fc9e0-4c9b-479b-9886-3a2c43639940 req-e56a88a7-25dc-44bc-a740-706075a88086 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438046
Jun 01 18:50:19.545126 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'name': 'network-vif-deleted', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:19.547394 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b79ab61d-a8b4-4f95-a6ea-96d4f4f9c168" -d '{"events": [{"server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "name": "network-vif-deleted", "tag": "69b10932-a965-4259-8f8c-39d6322653b1"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:19.567541 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d91c00d-a353-4b5a-a5af-14b52ecf4a57 req-2a0cb7bb-479e-4b08-8d39-8d08b283b34f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:19.571727 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.574330 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d91c00d-a353-4b5a-a5af-14b52ecf4a57 req-2a0cb7bb-479e-4b08-8d39-8d08b283b34f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 945 time: 0.2305851
Jun 01 18:50:19.589733 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cfb7a4aa-a200-41c8-9ffc-df98eb29b2f1 req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "DELETE /v2.0/ports/69b10932-a965-4259-8f8c-39d6322653b1 HTTP/1.1" status: 204  len: 173 time: 0.8412459
Jun 01 18:50:19.603098 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.628156 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d91c00d-a353-4b5a-a5af-14b52ecf4a57 req-8f1b38ab-ec3c-44d3-a2cf-9cbe5f00e19e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0528588
Jun 01 18:50:19.636233 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7db76eef-b06f-414d-b54d-2bd0bc992c07 x-openstack-request-id: req-7db76eef-b06f-414d-b54d-2bd0bc992c07 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:19.636601 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5", "name": "network-vif-deleted", "tag": "69b10932-a965-4259-8f8c-39d6322653b1", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:19.636888 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7db76eef-b06f-414d-b54d-2bd0bc992c07 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:19.638011 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5', 'name': 'network-vif-deleted', 'tag': '69b10932-a965-4259-8f8c-39d6322653b1', 'status': 'completed', 'code': 200}
Jun 01 18:50:19.661702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:19.663950 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c1829fca-529b-48e9-a098-61c839961654" -d '{"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:19.683517 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:19.700286 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:19.713248 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.717731 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:19.747029 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4afa697-50be-45de-805e-95aa1e28c6e3 x-openstack-request-id: req-e4afa697-50be-45de-805e-95aa1e28c6e3 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:19.747596 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:19.748004 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e4afa697-50be-45de-805e-95aa1e28c6e3 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:19.748593 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'code': 200}
Jun 01 18:50:19.752086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'port_id': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'mac_address': 'fa:16:3e:9a:1f:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 67, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:50:19.765500 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-277c153e-5d0d-4e8a-a71b-8f43086ba442 req-a8136b58-3d7d-4768-9fe6-2212af5c7539 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=b133e71e-2d4c-4acb-b6e3-61e8bb8c7ff5 HTTP/1.1" status: 200  len: 210 time: 0.0435276
Jun 01 18:50:19.872694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=8']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:19.882536 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.902658 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.903009 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.903343 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.903863 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.904194 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.904551 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.904879 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.905209 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.905696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.905897 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.906174 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.906551 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:50:19.917352 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:19.932126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 57350594-9e66-45d7-9d43-cd9828eb72bb {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:50:19.943702 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d657e1f9-3146-4851-80ea-055e12dbd78f req-b88a9d20-d03c-475a-8278-39d40f622ee5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:19.945292 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d657e1f9-3146-4851-80ea-055e12dbd78f req-b88a9d20-d03c-475a-8278-39d40f622ee5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0862868
Jun 01 18:50:19.969505 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:19.974972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:19.976823 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:19.993892 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d657e1f9-3146-4851-80ea-055e12dbd78f req-730c62cf-d04b-4504-8e22-24bd7f356949 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420685
Jun 01 18:50:20.083185 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:20.087982 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:20.326099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:20.745408 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c97a06-b3e9-45d8-ae39-21c21d517c74 req-7bf15885-a035-431a-92ea-f3931c2a23aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:20.746993 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-23c97a06-b3e9-45d8-ae39-21c21d517c74 req-7bf15885-a035-431a-92ea-f3931c2a23aa tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 944 time: 0.0878401
Jun 01 18:50:20.813001 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-23c97a06-b3e9-45d8-ae39-21c21d517c74 req-641b840d-de4f-46ee-9205-94dfccb941ca tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0594904
Jun 01 18:50:20.844483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651f5a3c-c54b-4f49-8e68-b3b355531f63 req-bf7f5d11-1045-4e9d-af9e-e2289dd53601 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:20.852178 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-651f5a3c-c54b-4f49-8e68-b3b355531f63 req-bf7f5d11-1045-4e9d-af9e-e2289dd53601 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1073754
Jun 01 18:50:20.901607 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-651f5a3c-c54b-4f49-8e68-b3b355531f63 req-a1de9432-0352-4a81-bf82-68f52bd5bc6c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0484722
Jun 01 18:50:21.181669 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c0edc2-162d-4f8b-944a-3cc9299abd12 req-ecc0718f-1d41-4a00-b71c-6fe38fde14f4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:21.183487 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-60c0edc2-162d-4f8b-944a-3cc9299abd12 req-ecc0718f-1d41-4a00-b71c-6fe38fde14f4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0822189
Jun 01 18:50:21.201052 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 69b10932-a965-4259-8f8c-39d6322653b1 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:21.233399 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-60c0edc2-162d-4f8b-944a-3cc9299abd12 req-8b8ef1e0-6d0d-4c12-81d9-7d1b219a10ee tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439360
Jun 01 18:50:21.239101 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 69b10932-a965-4259-8f8c-39d6322653b1 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:50:21.239496 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 69b10932-a965-4259-8f8c-39d6322653b1 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:50:21.816287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084fe55-3219-4694-8be0-a329691cad11 req-ba8f66d7-aac6-41cf-9c45-fc16fd762d0e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:21.817777 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2084fe55-3219-4694-8be0-a329691cad11 req-ba8f66d7-aac6-41cf-9c45-fc16fd762d0e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0800364
Jun 01 18:50:21.866147 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2084fe55-3219-4694-8be0-a329691cad11 req-1fe02ebb-ca97-4e0d-a0a1-8c48eac29832 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428107
Jun 01 18:50:22.016120 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf4dc66-22ed-4cc4-86a4-0cf4914a647e req-c1f85927-462f-4869-91b5-e09e57c63cb2 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:22.017742 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4cf4dc66-22ed-4cc4-86a4-0cf4914a647e req-c1f85927-462f-4869-91b5-e09e57c63cb2 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 944 time: 0.1010864
Jun 01 18:50:22.075064 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4cf4dc66-22ed-4cc4-86a4-0cf4914a647e req-93d0bc10-46d1-412e-9cc1-4c387888cf72 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0508912
Jun 01 18:50:22.182836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36594) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:22.306576 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-b3a805ca-124d-4f8b-8c6f-3647d3b69283 service neutron] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1221697
Jun 01 18:50:22.484048 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6cf4159-7c8a-4a8a-aea0-dd10c264e67e req-66140ab0-a885-42b0-9096-a8a1daae487a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:22.485685 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a6cf4159-7c8a-4a8a-aea0-dd10c264e67e req-66140ab0-a885-42b0-9096-a8a1daae487a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1175992
Jun 01 18:50:22.540016 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a6cf4159-7c8a-4a8a-aea0-dd10c264e67e req-c2c6e353-89bd-4349-a809-a175068dc381 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0478561
Jun 01 18:50:22.586439 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abea4b2-4f50-41bb-af64-dccba1359072 req-847f9c38-b73c-456a-9097-9b7629b977b6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:22.588206 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6abea4b2-4f50-41bb-af64-dccba1359072 req-847f9c38-b73c-456a-9097-9b7629b977b6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.1199725
Jun 01 18:50:22.637065 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6abea4b2-4f50-41bb-af64-dccba1359072 req-4b4d120e-f0d1-47ba-8289-4fc00490855e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429513
Jun 01 18:50:23.064767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a94d5c-1bce-4177-85a1-c979b3e5cefa req-91825b9c-a178-46b0-a18b-4151651ae086 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:23.068518 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e5a94d5c-1bce-4177-85a1-c979b3e5cefa req-91825b9c-a178-46b0-a18b-4151651ae086 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0849338
Jun 01 18:50:23.110870 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e5a94d5c-1bce-4177-85a1-c979b3e5cefa req-654ee04c-01ba-4e9c-bb24-1be7cef944f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389123
Jun 01 18:50:23.225746 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 57350594-9e66-45d7-9d43-cd9828eb72bb up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:50:23.269301 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4755700e-2e6a-4677-a09b-9f830603f2ed req-bdfa1203-7279-484b-a6e2-585a3b0b0280 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:23.271401 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4755700e-2e6a-4677-a09b-9f830603f2ed req-bdfa1203-7279-484b-a6e2-585a3b0b0280 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 944 time: 0.0857897
Jun 01 18:50:23.299273 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 57350594-9e66-45d7-9d43-cd9828eb72bb completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:50:23.304111 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 57350594-9e66-45d7-9d43-cd9828eb72bb triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:50:23.304605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:23.320545 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4755700e-2e6a-4677-a09b-9f830603f2ed req-7d144f50-461d-4968-9333-88401c7586cb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428162
Jun 01 18:50:23.430499 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:23.457846 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:23.460079 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfa1e2be-4421-47c4-876d-a2b42941f95f" -d '{"events": [{"server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "name": "network-vif-plugged", "status": "completed", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:23.468352 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:23.473534 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:23.474429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:23.506381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:23.541928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e613396b-f517-4aad-8902-3d473cabbdc1 x-openstack-request-id: req-e613396b-f517-4aad-8902-3d473cabbdc1 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:23.542227 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "name": "network-vif-plugged", "status": "completed", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:23.542489 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e613396b-f517-4aad-8902-3d473cabbdc1 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:23.542871 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'code': 200}
Jun 01 18:50:23.632192 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:23.640725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:23.793261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffb4735-382f-40ef-8b1f-b801420aff87 req-89c9423d-1a6a-4dae-ac0c-e6e3c250a161 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:23.800214 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3ffb4735-382f-40ef-8b1f-b801420aff87 req-89c9423d-1a6a-4dae-ac0c-e6e3c250a161 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1166422
Jun 01 18:50:23.873058 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3ffb4735-382f-40ef-8b1f-b801420aff87 req-724ddf7a-ba9f-491d-9b76-93508893ad07 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0716038
Jun 01 18:50:23.898902 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6df095-664b-403d-b325-15c430438634 req-15fcfd68-1b47-487d-8fc4-df2e822260e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:23.900367 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f6df095-664b-403d-b325-15c430438634 req-15fcfd68-1b47-487d-8fc4-df2e822260e9 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1098 time: 0.0919254
Jun 01 18:50:23.930515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e025c28-4641-40f5-a595-c93b876a9173 req-173d37e7-43f2-44b0-877c-981d34680d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:23.931202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-2e025c28-4641-40f5-a595-c93b876a9173 req-173d37e7-43f2-44b0-877c-981d34680d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:23.962142 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f6df095-664b-403d-b325-15c430438634 req-274c4357-66ab-46d9-b260-867ebc64160e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531738
Jun 01 18:50:23.963160 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-2e025c28-4641-40f5-a595-c93b876a9173 req-173d37e7-43f2-44b0-877c-981d34680d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:23.969745 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2e025c28-4641-40f5-a595-c93b876a9173 req-173d37e7-43f2-44b0-877c-981d34680d6c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.2101078
Jun 01 18:50:24.016962 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2e025c28-4641-40f5-a595-c93b876a9173 req-8379e16d-fa52-4f31-be9e-3f6fdf4e5063 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462687
Jun 01 18:50:24.302806 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daecf62a-268c-46fd-a0ed-73c9c12724a5 req-21241c6c-5c08-4a04-9484-4a1becae5fa1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:24.304295 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-daecf62a-268c-46fd-a0ed-73c9c12724a5 req-21241c6c-5c08-4a04-9484-4a1becae5fa1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0796199
Jun 01 18:50:24.350485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-5ee36528-cc02-4e5a-ac09-1f74a8a95b4e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:24.352217 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-5ee36528-cc02-4e5a-ac09-1f74a8a95b4e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.0868199
Jun 01 18:50:24.360735 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-daecf62a-268c-46fd-a0ed-73c9c12724a5 req-c82beac4-151f-424e-a034-20e72b2a4638 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503867
Jun 01 18:50:24.641048 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842a720a-4539-45fc-9a59-cdb074e14379 req-a9ee4b5b-24c6-47f9-8f22-6472396c4f33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:24.643099 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-a9ee4b5b-24c6-47f9-8f22-6472396c4f33 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 1096 time: 0.2301993
Jun 01 18:50:24.652373 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98f1d50-c74c-4fc8-8c6b-493ff7889cfb req-c2d870d9-57e8-43f7-93e5-31c3c884c214 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:24.653752 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f98f1d50-c74c-4fc8-8c6b-493ff7889cfb req-c2d870d9-57e8-43f7-93e5-31c3c884c214 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1953449
Jun 01 18:50:24.679031 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Deleting port 4878da57-0d45-4191-82df-acc476090da6 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:50:24.679372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:24.855576 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f98f1d50-c74c-4fc8-8c6b-493ff7889cfb req-600f8070-8897-4538-9899-f72bf0412b38 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1949337
Jun 01 18:50:24.966272 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] For port 4878da57-0d45-4191-82df-acc476090da6, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4878da57-0d45-4191-82df-acc476090da6,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:24.966709 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:25.073752 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed508ebe-b11e-4edc-89ed-dfb513f34a3c req-dc86e712-51a5-471f-9402-b6e0ed922ae2 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.075543 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ed508ebe-b11e-4edc-89ed-dfb513f34a3c req-dc86e712-51a5-471f-9402-b6e0ed922ae2 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0948582
Jun 01 18:50:25.102475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842a720a-4539-45fc-9a59-cdb074e14379 req-218a70b0-3117-4a93-b83f-24e6492a0c87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.104034 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-218a70b0-3117-4a93-b83f-24e6492a0c87 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1096 time: 0.4089096
Jun 01 18:50:25.111729 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Calling delete_port for 4878da57-0d45-4191-82df-acc476090da6 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:50:25.137238 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ed508ebe-b11e-4edc-89ed-dfb513f34a3c req-3c1071a8-8f6d-4d86-b80e-82af82b29439 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0552917
Jun 01 18:50:25.341117 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842a720a-4539-45fc-9a59-cdb074e14379 req-dc8cab52-74c5-48ec-ae4e-3a39b066949b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.342464 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-dc8cab52-74c5-48ec-ae4e-3a39b066949b service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.2274222
Jun 01 18:50:25.350384 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8588749-45e5-42f4-85db-a11cce1d3ed5 req-07114e5a-8bbe-4199-af5f-5a66ef06ee74 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.351703 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a8588749-45e5-42f4-85db-a11cce1d3ed5 req-07114e5a-8bbe-4199-af5f-5a66ef06ee74 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=9fa50c76-c546-4530-a63d-40e7f67b8d74 HTTP/1.1" status: 200  len: 945 time: 0.2132597
Jun 01 18:50:25.529631 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a8588749-45e5-42f4-85db-a11cce1d3ed5 req-6c3a91ec-f1a9-4a0f-9a91-37c78dd7da0a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0934224
Jun 01 18:50:25.535111 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-debd182a-fe7b-44ee-93cb-6648c521d68b service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 200  len: 998 time: 0.1825247
Jun 01 18:50:25.540341 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:25.555418 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256', '00a066ed-ad86-4d31-9083-bf2f681a2c2c'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:25.573656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb11cb49-78cd-443c-8fe1-294b5a870239 req-3cb90e8b-3aa7-4345-9d3f-95d0129c2165 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.575815 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cb11cb49-78cd-443c-8fe1-294b5a870239 req-3cb90e8b-3aa7-4345-9d3f-95d0129c2165 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0865321
Jun 01 18:50:25.581604 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-578add48-fbc5-428a-8e9e-263bd775a71f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:25.625384 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cb11cb49-78cd-443c-8fe1-294b5a870239 req-22f1c59c-4dac-46bf-8ee9-8644ad7acf54 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425489
Jun 01 18:50:25.628284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event deleted for resources: {'Port': ['ID=4878da57-0d45-4191-82df-acc476090da6,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:25.671093 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:25.721205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] No DVR routers for this DVR port 4878da57-0d45-4191-82df-acc476090da6 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:50:25.723715 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:25.729405 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'name': 'network-vif-deleted', 'tag': '4878da57-0d45-4191-82df-acc476090da6'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:25.731615 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d053ed3c-0438-4d62-a817-75cfff499a86" -d '{"events": [{"server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "name": "network-vif-deleted", "tag": "4878da57-0d45-4191-82df-acc476090da6"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:25.739819 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842a720a-4539-45fc-9a59-cdb074e14379 req-f354a3bb-1aa4-40d1-bcd4-8fae36706f8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.741775 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-f354a3bb-1aa4-40d1-bcd4-8fae36706f8f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.1990612
Jun 01 18:50:25.748079 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca852591-ba78-4dcd-98b0-4e5f91e42dc8 req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "DELETE /v2.0/ports/4878da57-0d45-4191-82df-acc476090da6 HTTP/1.1" status: 204  len: 173 time: 1.3785186
Jun 01 18:50:25.795429 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4d9a69c-9d72-4bc5-bf54-8f9c972173b4 x-openstack-request-id: req-d4d9a69c-9d72-4bc5-bf54-8f9c972173b4 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:25.795742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9fa50c76-c546-4530-a63d-40e7f67b8d74", "name": "network-vif-deleted", "tag": "4878da57-0d45-4191-82df-acc476090da6", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:25.796014 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d4d9a69c-9d72-4bc5-bf54-8f9c972173b4 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:25.796416 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9fa50c76-c546-4530-a63d-40e7f67b8d74', 'name': 'network-vif-deleted', 'tag': '4878da57-0d45-4191-82df-acc476090da6', 'status': 'completed', 'code': 200}
Jun 01 18:50:25.827212 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842a720a-4539-45fc-9a59-cdb074e14379 req-a39a10f5-63a4-4d16-a445-a2c6a1ea93f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:25.828686 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-a39a10f5-63a4-4d16-a445-a2c6a1ea93f2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0793133
Jun 01 18:50:25.966324 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-355c3b50-311a-4944-9c33-6d4fd45f37a0 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274278
Jun 01 18:50:26.108754 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-842a720a-4539-45fc-9a59-cdb074e14379 req-b6ed4d1e-2470-47e9-9066-c6845d42718c service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1351233
Jun 01 18:50:26.131821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e765306b-8b60-478f-a2e5-f95ad9578629 req-6da5efbb-0f36-465a-bd82-fa415b43852e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:26.133322 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e765306b-8b60-478f-a2e5-f95ad9578629 req-6da5efbb-0f36-465a-bd82-fa415b43852e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1640007
Jun 01 18:50:26.178904 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e765306b-8b60-478f-a2e5-f95ad9578629 req-a502e31f-d54c-4162-827d-7ef20aa7d3dc tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395830
Jun 01 18:50:26.348590 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7df2214-033d-4f8c-a503-1f0ef7fd1651 req-e8d0dd6e-a6eb-4578-9d2c-37239dabb5df tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:26.355636 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d7df2214-033d-4f8c-a503-1f0ef7fd1651 req-e8d0dd6e-a6eb-4578-9d2c-37239dabb5df tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1070726
Jun 01 18:50:26.406851 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7980ee-04e2-4ae8-b8de-3a5e4bd18a7d req-60134344-8cf7-4a6d-95af-e0aee7d160de tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:26.409142 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8f7980ee-04e2-4ae8-b8de-3a5e4bd18a7d req-60134344-8cf7-4a6d-95af-e0aee7d160de tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1134381
Jun 01 18:50:26.416223 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d7df2214-033d-4f8c-a503-1f0ef7fd1651 req-3b2775ea-d9a5-4617-b8cf-6d1fbd8d7ef9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526664
Jun 01 18:50:26.462939 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8f7980ee-04e2-4ae8-b8de-3a5e4bd18a7d req-cf489a9f-41b0-459b-8b9b-40a5aa1539c5 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427392
Jun 01 18:50:26.943003 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d9a5427-9733-49f4-9889-2d4941802117 req-58994fd0-e10c-4dce-8b20-e9dc6746141b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:26.944746 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3d9a5427-9733-49f4-9889-2d4941802117 req-58994fd0-e10c-4dce-8b20-e9dc6746141b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1386108
Jun 01 18:50:27.013699 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3d9a5427-9733-49f4-9889-2d4941802117 req-d3791077-90aa-458b-9236-d1d06c784379 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0567579
Jun 01 18:50:27.224177 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 4878da57-0d45-4191-82df-acc476090da6 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:27.238032 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0bae29c-95b8-4cb8-8894-06000cfa8628 req-497adf3f-bf7c-43b3-b18a-0ce7d0bfca48 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:27.241181 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f0bae29c-95b8-4cb8-8894-06000cfa8628 req-497adf3f-bf7c-43b3-b18a-0ce7d0bfca48 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1547580
Jun 01 18:50:27.300333 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 4878da57-0d45-4191-82df-acc476090da6 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:50:27.301244 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 4878da57-0d45-4191-82df-acc476090da6 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:50:27.327925 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f0bae29c-95b8-4cb8-8894-06000cfa8628 req-329fda47-0e54-4e17-b740-ec76d890d99f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757823
Jun 01 18:50:27.466794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b2fcda4-aed4-4960-b841-21c86c921072 req-3a2e2ab5-92e5-464a-ac1b-c5552b4ab12c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:27.468128 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-4b2fcda4-aed4-4960-b841-21c86c921072 req-3a2e2ab5-92e5-464a-ac1b-c5552b4ab12c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:27.490092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-4b2fcda4-aed4-4960-b841-21c86c921072 req-3a2e2ab5-92e5-464a-ac1b-c5552b4ab12c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:27.491532 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b2fcda4-aed4-4960-b841-21c86c921072 req-3a2e2ab5-92e5-464a-ac1b-c5552b4ab12c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.3171999
Jun 01 18:50:27.543172 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b2fcda4-aed4-4960-b841-21c86c921072 req-5b0916d6-9656-45d8-963e-7a62c63acf5c tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451233
Jun 01 18:50:27.633583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3745b68-1665-474f-9eb6-fe05d8ce44b7 req-6843470a-a1a5-4326-8c85-a44c609e6e28 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:27.635102 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c3745b68-1665-474f-9eb6-fe05d8ce44b7 req-6843470a-a1a5-4326-8c85-a44c609e6e28 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0946994
Jun 01 18:50:27.690580 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c3745b68-1665-474f-9eb6-fe05d8ce44b7 req-b8888723-c5c4-4ede-9fbe-0e94b8fa4405 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489328
Jun 01 18:50:28.198727 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8b697c-f933-4813-9d16-080570be2b97 req-d783853c-19b0-4898-9253-1e157cc4e3b6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:28.200153 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c8b697c-f933-4813-9d16-080570be2b97 req-d783853c-19b0-4898-9253-1e157cc4e3b6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0848966
Jun 01 18:50:28.246687 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c8b697c-f933-4813-9d16-080570be2b97 req-044722c6-0998-4d33-b580-f23f3beb38fa tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401084
Jun 01 18:50:28.787790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec940d51-33a9-4647-ba01-d73feb927674 req-9750c627-808e-4794-bded-fd8dfbed3e1d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:28.789334 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec940d51-33a9-4647-ba01-d73feb927674 req-9750c627-808e-4794-bded-fd8dfbed3e1d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.1194286
Jun 01 18:50:28.881072 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec940d51-33a9-4647-ba01-d73feb927674 req-a51e1beb-ddcb-4d46-936f-f9cb2d172bed tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0838711
Jun 01 18:50:28.895492 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37d1038-8213-4089-a57c-6a73ab4af836 req-4d70eb7f-261e-433f-89b9-82a222af617c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:28.897099 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a37d1038-8213-4089-a57c-6a73ab4af836 req-4d70eb7f-261e-433f-89b9-82a222af617c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0849583
Jun 01 18:50:28.917718 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36766) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:28.944544 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a37d1038-8213-4089-a57c-6a73ab4af836 req-ff86c478-4028-47eb-bf18-05e54fd4e990 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414057
Jun 01 18:50:29.097181 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.113145 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:29.117109 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Usage tracker for resource:security_group_rule and tenant:b9df6cde35974b8ca6db535ac3a60a71 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:29.120881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:29.126943 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:29.213621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.223966 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.239095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c1ffd7ab-029c-4f3b-9f0d-ff9922e82599 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:29.271177 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=b9df6cde35974b8ca6db535ac3a60a71&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3501768
Jun 01 18:50:29.271853 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 36778) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:29.297913 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6299b394-fca2-4c6b-929a-c7a9bb1bc3fb,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:29.302003 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:29.355726 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.391555 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.453875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.459441 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b0e7580e-7513-4b6f-8294-540f603b3795 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:29.482855 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6299b394-fca2-4c6b-929a-c7a9bb1bc3fb,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:29.489936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:29.489936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:29.489936 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6299b394-fca2-4c6b-929a-c7a9bb1bc3fb HTTP/1.1" status: 204  len: 168 time: 0.2165830
Jun 01 18:50:29.523412 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3115230f-cedb-4744-b4de-3dff26020a96 req-5511535a-5ba5-4d51-9acd-9165276d0428 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:29.532326 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3115230f-cedb-4744-b4de-3dff26020a96 req-5511535a-5ba5-4d51-9acd-9165276d0428 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1528635
Jun 01 18:50:29.605140 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3115230f-cedb-4744-b4de-3dff26020a96 req-6a9dad95-dcc0-4ea6-a5cf-e495520c256c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0703113
Jun 01 18:50:30.069375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0818e115-c632-4f6c-9973-4e86226b9246 req-aeb34416-c83e-4a93-bcf5-19405112677b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:30.070819 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0818e115-c632-4f6c-9973-4e86226b9246 req-aeb34416-c83e-4a93-bcf5-19405112677b tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0822074
Jun 01 18:50:30.115402 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0818e115-c632-4f6c-9973-4e86226b9246 req-43aa61a3-f964-4aa2-9401-a7b6ca7613df tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389216
Jun 01 18:50:30.302359 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4853533c-40a6-4079-801e-34955db34ab4 req-2b0c124d-cebc-401c-8e4a-41fe53a22bd9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:30.303756 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4853533c-40a6-4079-801e-34955db34ab4 req-2b0c124d-cebc-401c-8e4a-41fe53a22bd9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0892873
Jun 01 18:50:30.349291 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4853533c-40a6-4079-801e-34955db34ab4 req-b7dd855c-fb11-4c3e-b340-0acdfb38c591 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387197
Jun 01 18:50:30.799779 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1c5bb8-8f40-47d4-96bf-0966c7ded914 req-e80830bb-aa7a-4fa0-bac0-7f26fd546dd7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:30.801270 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8a1c5bb8-8f40-47d4-96bf-0966c7ded914 req-e80830bb-aa7a-4fa0-bac0-7f26fd546dd7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0895290
Jun 01 18:50:30.844735 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8a1c5bb8-8f40-47d4-96bf-0966c7ded914 req-3cd2a84b-b1c5-4784-9751-2fa0d4fdd532 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377109
Jun 01 18:50:31.321042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f195c14-19e5-4a24-9d48-384d0c40d2c4 req-1c5ab194-d077-46ed-952e-c9201d76a836 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:31.322509 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f195c14-19e5-4a24-9d48-384d0c40d2c4 req-1c5ab194-d077-46ed-952e-c9201d76a836 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0952649
Jun 01 18:50:31.366387 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f195c14-19e5-4a24-9d48-384d0c40d2c4 req-62679bee-e2f6-48ea-b069-267a0bc36e62 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382664
Jun 01 18:50:31.547869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d661085c-3ee4-4989-8a28-2f0c22cb5016 req-748972b5-dd70-4bf4-a1d3-8e224eb820ae tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:31.549907 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d661085c-3ee4-4989-8a28-2f0c22cb5016 req-748972b5-dd70-4bf4-a1d3-8e224eb820ae tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0799508
Jun 01 18:50:31.600678 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d661085c-3ee4-4989-8a28-2f0c22cb5016 req-fff4c103-522a-4b58-b841-fdc25b1c89e1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443220
Jun 01 18:50:32.040569 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04739a0-8299-49c6-8ef3-6a325b63020f req-7c15a873-b4b7-4057-9338-e2940ef3885e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:32.042073 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b04739a0-8299-49c6-8ef3-6a325b63020f req-7c15a873-b4b7-4057-9338-e2940ef3885e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0855923
Jun 01 18:50:32.087864 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b04739a0-8299-49c6-8ef3-6a325b63020f req-4d868701-ef00-4d2f-84bb-30ba5ab5fd2d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400865
Jun 01 18:50:32.560580 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5518b837-0af9-4d99-b2c7-6dba42ae99ac req-a7f1cefc-ee09-4781-a690-846599a36b5d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:32.562031 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5518b837-0af9-4d99-b2c7-6dba42ae99ac req-a7f1cefc-ee09-4781-a690-846599a36b5d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0901313
Jun 01 18:50:32.605795 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5518b837-0af9-4d99-b2c7-6dba42ae99ac req-c425db77-5b9c-45b5-a471-6cb4a3356f22 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376644
Jun 01 18:50:32.809366 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c15e05dd-0044-41d6-8f0e-06878fbf56a6 req-8589cc63-b82e-46e6-b297-a4c51c537833 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:32.811328 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c15e05dd-0044-41d6-8f0e-06878fbf56a6 req-8589cc63-b82e-46e6-b297-a4c51c537833 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0855036
Jun 01 18:50:32.856699 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c15e05dd-0044-41d6-8f0e-06878fbf56a6 req-e6149935-e7e7-4f4b-bcb7-9e83aaf2dd51 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392673
Jun 01 18:50:33.290733 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61efdb8-cc8d-487a-b303-86f4f92afafc req-915a50a1-4dc6-4199-b1da-caa653a1cda9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:33.292213 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e61efdb8-cc8d-487a-b303-86f4f92afafc req-915a50a1-4dc6-4199-b1da-caa653a1cda9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0850730
Jun 01 18:50:33.341340 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e61efdb8-cc8d-487a-b303-86f4f92afafc req-1893611b-195d-4880-9af7-dd723bdde10b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427999
Jun 01 18:50:33.792559 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56984215-fee1-4cd6-9d55-f63a02f91268 req-b627970d-86ec-44a4-ba48-f9769cb1b750 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:33.794175 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-56984215-fee1-4cd6-9d55-f63a02f91268 req-b627970d-86ec-44a4-ba48-f9769cb1b750 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0817654
Jun 01 18:50:33.852125 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-56984215-fee1-4cd6-9d55-f63a02f91268 req-a42580fb-1ad8-4e5b-8439-999ac6c2a8f9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0492814
Jun 01 18:50:34.200436 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d47de53-6b8f-4b81-b7d6-b4c50ad0c5d4 req-a3961660-abcf-470e-b466-ce6092ddb5f3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:34.201906 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d47de53-6b8f-4b81-b7d6-b4c50ad0c5d4 req-a3961660-abcf-470e-b466-ce6092ddb5f3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0873544
Jun 01 18:50:34.249068 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d47de53-6b8f-4b81-b7d6-b4c50ad0c5d4 req-f8dbae93-b541-4f64-a31c-9b818808ef34 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414619
Jun 01 18:50:34.540038 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab36b6-9518-4a6f-a1ea-449e9e96b155 req-41b0b7e9-fb39-42fe-9c93-d39740ee60a6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:34.541840 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-62ab36b6-9518-4a6f-a1ea-449e9e96b155 req-41b0b7e9-fb39-42fe-9c93-d39740ee60a6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0801985
Jun 01 18:50:34.652677 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-62ab36b6-9518-4a6f-a1ea-449e9e96b155 req-9e92a4dc-9916-4b68-b412-509612de19bc tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1043291
Jun 01 18:50:35.037162 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b335f49-c4b0-4216-a4c1-1e82b3b553c6 req-2130af2a-cb38-4e8c-9849-404f993ff852 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:35.038612 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b335f49-c4b0-4216-a4c1-1e82b3b553c6 req-2130af2a-cb38-4e8c-9849-404f993ff852 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0795977
Jun 01 18:50:35.110220 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b335f49-c4b0-4216-a4c1-1e82b3b553c6 req-d13d3017-59ab-4c59-b81b-5ad7e7619114 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658495
Jun 01 18:50:35.441486 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c771225-ca30-4875-a6e3-8956a6bd53ac req-16215080-ab77-4852-a0d5-00c687db263e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:35.442969 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2c771225-ca30-4875-a6e3-8956a6bd53ac req-16215080-ab77-4852-a0d5-00c687db263e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0818067
Jun 01 18:50:35.492645 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2c771225-ca30-4875-a6e3-8956a6bd53ac req-e90de1e4-beb8-4cb9-94dd-b7b9dbb6d35c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428061
Jun 01 18:50:35.850726 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dffea3ea-18da-4123-9ae9-68ffad47055f req-3888d5cb-d191-4a84-9def-e197816b95cc tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:35.852197 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dffea3ea-18da-4123-9ae9-68ffad47055f req-3888d5cb-d191-4a84-9def-e197816b95cc tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0830092
Jun 01 18:50:35.898939 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dffea3ea-18da-4123-9ae9-68ffad47055f req-a6027885-25de-4e4a-91f7-14f1b9775f99 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410409
Jun 01 18:50:36.302898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19495c2a-2f88-433d-b2fe-eb5fcf2326fd req-b22b994b-cba8-474f-a478-8e195a01f378 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:36.304364 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-19495c2a-2f88-433d-b2fe-eb5fcf2326fd req-b22b994b-cba8-474f-a478-8e195a01f378 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0877023
Jun 01 18:50:36.348675 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-19495c2a-2f88-433d-b2fe-eb5fcf2326fd req-1fea59a1-b12e-421a-bac6-57ed9d3b9395 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385683
Jun 01 18:50:36.709286 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d306ed71-f025-443c-ba97-b201f6a47e96 req-bd4fcafc-5613-42cf-9428-1799579e392e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:36.711304 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d306ed71-f025-443c-ba97-b201f6a47e96 req-bd4fcafc-5613-42cf-9428-1799579e392e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0987892
Jun 01 18:50:36.755105 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d306ed71-f025-443c-ba97-b201f6a47e96 req-a5050dd7-5242-422e-9a26-61adc2399b04 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384932
Jun 01 18:50:37.097795 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c69432-f7c6-4a98-83da-789e1822825b req-27a75bab-15e6-442a-a9ae-eb9983b2be11 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:37.099182 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2c69432-f7c6-4a98-83da-789e1822825b req-27a75bab-15e6-442a-a9ae-eb9983b2be11 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0878358
Jun 01 18:50:37.144357 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c2c69432-f7c6-4a98-83da-789e1822825b req-efb4f82e-c215-450d-801f-374d7c2de4a6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394931
Jun 01 18:50:37.535588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64881d-998a-4e16-bfd8-5a3929921f31 req-b63334a2-d3dd-4776-b684-6653dc5059f8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:37.537079 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-fb64881d-998a-4e16-bfd8-5a3929921f31 req-b63334a2-d3dd-4776-b684-6653dc5059f8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0858545
Jun 01 18:50:37.580068 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-fb64881d-998a-4e16-bfd8-5a3929921f31 req-7fb9ff2c-b2d5-4705-acad-6ee5e073ff01 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0368559
Jun 01 18:50:37.946108 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659f6953-0220-48b8-b0ef-c3c5dbf91f7b req-d31f3511-cce8-4a99-8af9-f198cef9cb60 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:37.947998 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-659f6953-0220-48b8-b0ef-c3c5dbf91f7b req-d31f3511-cce8-4a99-8af9-f198cef9cb60 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0831718
Jun 01 18:50:37.999810 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-659f6953-0220-48b8-b0ef-c3c5dbf91f7b req-be780823-51c8-4f6a-9223-310187aae158 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457573
Jun 01 18:50:38.339680 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b733ce6b-9f31-425c-9eb5-2481096fd86e req-1aefd34f-3957-4905-bab9-5dd51a99910f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:38.341069 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b733ce6b-9f31-425c-9eb5-2481096fd86e req-1aefd34f-3957-4905-bab9-5dd51a99910f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0807869
Jun 01 18:50:38.390671 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b733ce6b-9f31-425c-9eb5-2481096fd86e req-e4fca826-7b93-4ec3-b9e0-921954e98019 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437961
Jun 01 18:50:38.770306 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d9433a-2389-4591-aa1b-eb5b0c83df02 req-9c14c4e1-cb82-4876-b9d9-1ee4bd59e187 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:38.771618 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-83d9433a-2389-4591-aa1b-eb5b0c83df02 req-9c14c4e1-cb82-4876-b9d9-1ee4bd59e187 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0834942
Jun 01 18:50:38.817614 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-83d9433a-2389-4591-aa1b-eb5b0c83df02 req-7d2edd9d-f35e-4c03-8e8b-849cabdb9fc8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398576
Jun 01 18:50:39.047574 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:39.189161 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05301750-3c0e-4245-a6bf-a96938efba63 req-83a579df-4f2e-418f-96ec-6c0cc4020093 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:39.190561 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-05301750-3c0e-4245-a6bf-a96938efba63 req-83a579df-4f2e-418f-96ec-6c0cc4020093 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0790739
Jun 01 18:50:39.233825 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-05301750-3c0e-4245-a6bf-a96938efba63 req-8a12361e-df11-4628-92ef-a08fec078fc4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376127
Jun 01 18:50:39.592588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c70785-eee8-435e-962e-181657239dc9 req-58adf58d-cea3-45d6-a09f-6be981373634 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:39.594027 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1c70785-eee8-435e-962e-181657239dc9 req-58adf58d-cea3-45d6-a09f-6be981373634 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0818546
Jun 01 18:50:39.636279 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1c70785-eee8-435e-962e-181657239dc9 req-555dabd1-b0d8-4d0b-adfd-c34755aa80c4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0367916
Jun 01 18:50:39.829151 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-cb9c32a3-97aa-4ac2-8458-f92f753a3329 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0706861
Jun 01 18:50:39.936537 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-b9d5b275-7313-4a14-a4fa-e96484dc573b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:39.937999 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-b9d5b275-7313-4a14-a4fa-e96484dc573b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 1098 time: 0.0803618
Jun 01 18:50:40.025684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b64b3fc-b262-4ff2-acb8-f019e3caef25 req-d24c63fe-5ce8-4274-a88e-d8d7d2f509c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.027170 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0b64b3fc-b262-4ff2-acb8-f019e3caef25 req-d24c63fe-5ce8-4274-a88e-d8d7d2f509c8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0937343
Jun 01 18:50:40.093831 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0b64b3fc-b262-4ff2-acb8-f019e3caef25 req-62d7552a-ac76-43ff-9e1b-bddd3d6aa305 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601854
Jun 01 18:50:40.114418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-9a1da094-d6db-4900-8440-44af284b61f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.115882 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-9a1da094-d6db-4900-8440-44af284b61f8 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.1339643
Jun 01 18:50:40.182141 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-0e4f1ff6-c299-4ce3-a2d7-80a3a1d9cb64 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98 HTTP/1.1" status: 200  len: 217 time: 0.0593512
Jun 01 18:50:40.248124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-89b30280-8a7a-4949-9b50-27fe5a3083b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.249552 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-89b30280-8a7a-4949-9b50-27fe5a3083b9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0580211
Jun 01 18:50:40.301588 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-7a91af21-7d63-4026-8acd-42c9799336d2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0404360
Jun 01 18:50:40.489037 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-91eb677d-ba97-41fc-824e-21ce2cf17572 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1792467
Jun 01 18:50:40.523489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a0d967-9a11-491f-bfe0-bc7f278cc819 req-bc155844-35ba-4a70-8f59-fa03d86cb0ef tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.524922 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-43a0d967-9a11-491f-bfe0-bc7f278cc819 req-bc155844-35ba-4a70-8f59-fa03d86cb0ef tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1806283
Jun 01 18:50:40.636751 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-43a0d967-9a11-491f-bfe0-bc7f278cc819 req-1995c823-3ac5-4feb-b99c-406b668b1960 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1047933
Jun 01 18:50:40.708728 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ae2341c-991a-4349-9980-5f22517bafc6 req-35ee0a74-f442-4328-b5b3-8e5d475e6e7e service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2120450
Jun 01 18:50:40.732174 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8acb2a-fdda-4de7-9605-5f95311bd950 req-06e94404-8692-44bb-9d83-b30c0053bd9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.733742 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9e8acb2a-fdda-4de7-9605-5f95311bd950 req-06e94404-8692-44bb-9d83-b30c0053bd9d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.0896189
Jun 01 18:50:40.788654 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9e8acb2a-fdda-4de7-9605-5f95311bd950 req-9707a5e4-a245-46d8-92ef-478ea4c77ab3 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431981
Jun 01 18:50:40.840333 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21211729-a056-48f6-9521-3d518a5961ca req-4cb9aade-587a-4bc5-bf70-0e25bc685b79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:40.841794 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-21211729-a056-48f6-9521-3d518a5961ca req-4cb9aade-587a-4bc5-bf70-0e25bc685b79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0847685
Jun 01 18:50:40.884410 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-21211729-a056-48f6-9521-3d518a5961ca req-ab3c1b1b-2f53-449f-9621-bb78b48e00f0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0369911
Jun 01 18:50:41.227212 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:50:41.274681 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9717abb1-b178-4671-8ca9-5bb487add15a req-603d1298-88e5-4827-846a-7b9e1b3aecd7 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:41.276102 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9717abb1-b178-4671-8ca9-5bb487add15a req-603d1298-88e5-4827-846a-7b9e1b3aecd7 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0804324
Jun 01 18:50:41.320865 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9717abb1-b178-4671-8ca9-5bb487add15a req-d4a72fed-60ab-497b-8d30-cbab6a5e19c7 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387573
Jun 01 18:50:41.790519 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-65806dac-3e19-4744-858e-4fdeb8b2c7b6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:41.791957 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-65806dac-3e19-4744-858e-4fdeb8b2c7b6 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0896580
Jun 01 18:50:41.824957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09a366f-307d-459a-b4eb-19d743045574 req-709e9ee8-a05a-4518-8dc4-a842cab24fd9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:41.826424 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b09a366f-307d-459a-b4eb-19d743045574 req-709e9ee8-a05a-4518-8dc4-a842cab24fd9 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0840838
Jun 01 18:50:41.874559 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b09a366f-307d-459a-b4eb-19d743045574 req-f95331c3-49be-4307-b93b-4513903a475a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422630
Jun 01 18:50:41.929116 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Deleting port 00a066ed-ad86-4d31-9083-bf2f681a2c2c {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:50:41.929461 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:42.193739 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] For port 00a066ed-ad86-4d31-9083-bf2f681a2c2c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=00a066ed-ad86-4d31-9083-bf2f681a2c2c,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:42.194088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:42.265530 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbdb66-e1b1-4dac-8937-e0b4ce167f58 req-1ae3b75b-82b7-4e6b-a5a9-15051aa16f25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:42.267481 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-accbdb66-e1b1-4dac-8937-e0b4ce167f58 req-1ae3b75b-82b7-4e6b-a5a9-15051aa16f25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.2330744
Jun 01 18:50:42.327813 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Calling delete_port for 00a066ed-ad86-4d31-9083-bf2f681a2c2c owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:50:42.383277 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-accbdb66-e1b1-4dac-8937-e0b4ce167f58 req-121c67f7-5c18-4ede-8c1e-b7dd1a8f7b3d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0620430
Jun 01 18:50:42.485276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:42.490658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:42.497247 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256', '00a066ed-ad86-4d31-9083-bf2f681a2c2c'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:42.503380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8df2702-0e87-47ef-8978-a836debfe1e7 req-58a065a9-d937-49c0-8b51-2ccb3e8e5c76 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:42.504873 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8df2702-0e87-47ef-8978-a836debfe1e7 req-58a065a9-d937-49c0-8b51-2ccb3e8e5c76 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=bc8467b8-68c0-456d-b0e5-e36683bf3991 HTTP/1.1" status: 200  len: 945 time: 0.0802979
Jun 01 18:50:42.533590 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event deleted for resources: {'Port': ['ID=00a066ed-ad86-4d31-9083-bf2f681a2c2c,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:42.538074 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:42.554018 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a8df2702-0e87-47ef-8978-a836debfe1e7 req-00411d84-2b71-4cbc-af1c-0ecf7f8b7347 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431409
Jun 01 18:50:42.616372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] No DVR routers for this DVR port 00a066ed-ad86-4d31-9083-bf2f681a2c2c on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:50:42.618779 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:42.621258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'name': 'network-vif-deleted', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:42.623535 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-539f1eaf-bf60-48ec-a7e7-70d6766d6dd3" -d '{"events": [{"server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "name": "network-vif-deleted", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:42.636910 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b96b7dfc-9fa7-489a-b088-3ba9882103c7 req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "DELETE /v2.0/ports/00a066ed-ad86-4d31-9083-bf2f681a2c2c HTTP/1.1" status: 204  len: 173 time: 0.8347137
Jun 01 18:50:42.678101 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df9c2121-ec29-43f0-86f3-8423ca6507a0 x-openstack-request-id: req-df9c2121-ec29-43f0-86f3-8423ca6507a0 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:42.678410 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc8467b8-68c0-456d-b0e5-e36683bf3991", "name": "network-vif-deleted", "tag": "00a066ed-ad86-4d31-9083-bf2f681a2c2c", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:42.678974 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-df9c2121-ec29-43f0-86f3-8423ca6507a0 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:42.679191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc8467b8-68c0-456d-b0e5-e36683bf3991', 'name': 'network-vif-deleted', 'tag': '00a066ed-ad86-4d31-9083-bf2f681a2c2c', 'status': 'completed', 'code': 200}
Jun 01 18:50:43.060767 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a3b1c5-81e2-4b27-b6c7-7a59ad2b3218 req-d7a309b1-5b91-4f78-bf45-613ded09d7e7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.062292 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a1a3b1c5-81e2-4b27-b6c7-7a59ad2b3218 req-d7a309b1-5b91-4f78-bf45-613ded09d7e7 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0817082
Jun 01 18:50:43.106266 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a1a3b1c5-81e2-4b27-b6c7-7a59ad2b3218 req-955975cf-3f20-48e0-ba69-655bcac7f837 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378084
Jun 01 18:50:43.637839 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d931d20c-e284-46be-9b77-9dddc4e0b5ef req-f065ea87-cd58-445e-849b-30133ed5b2a5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.638100 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506d1014-2994-4719-9eff-f81bfdfcd267 req-6e5b8228-533c-4ca3-93ef-eca08984edb4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.639310 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d931d20c-e284-46be-9b77-9dddc4e0b5ef req-f065ea87-cd58-445e-849b-30133ed5b2a5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0793626
Jun 01 18:50:43.639510 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-506d1014-2994-4719-9eff-f81bfdfcd267 req-6e5b8228-533c-4ca3-93ef-eca08984edb4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1383846
Jun 01 18:50:43.642114 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-7dc0726c-321d-4e58-9c67-ec676f8781a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.643409 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-7dc0726c-321d-4e58-9c67-ec676f8781a7 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 1098 time: 0.1064415
Jun 01 18:50:43.690846 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d931d20c-e284-46be-9b77-9dddc4e0b5ef req-3c357064-e2cd-4768-aef7-28fb904b0739 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453391
Jun 01 18:50:43.786047 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-506d1014-2994-4719-9eff-f81bfdfcd267 req-e0cd3374-561c-4497-8a79-318e0aab17eb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1394794
Jun 01 18:50:43.826805 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-6068fa8d-8531-4499-bca2-9c8adf453e34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.828552 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-6068fa8d-8531-4499-bca2-9c8adf453e34 service neutron] 10.222.0.25 "GET /v2.0/networks?id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 200  len: 919 time: 0.1663275
Jun 01 18:50:43.904303 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-07b092b9-b3dc-406e-b52e-059e61b13234 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 200  len: 217 time: 0.0631154
Jun 01 18:50:43.969792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-54807710-6cfa-4847-b613-ba19f2db26c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:43.971252 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-54807710-6cfa-4847-b613-ba19f2db26c7 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 200  len: 859 time: 0.0599229
Jun 01 18:50:44.027937 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-d3e7fb02-dee2-4057-a02d-debb672ec52d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=7c0d1d41-a033-4bad-b3c8-a15d3b31242e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0441184
Jun 01 18:50:44.125345 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-28755fa3-8cb5-4fa0-babf-6fd837e20aa7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:44.158487 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-e8862f92-24f4-4f38-9e0d-311242d53624 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1228304
Jun 01 18:50:44.287546 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4b25554-2b54-499c-bd6f-ed6643e86a4b req-f7294dea-99b5-4370-9cec-561d6519e3e3 service neutron] 10.222.0.25 "GET /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1215653
Jun 01 18:50:44.943591 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226a5438-52d8-4e4f-8326-7b249ec5988e req-352c401a-0415-469c-9201-2978acb28647 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:44.945070 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-226a5438-52d8-4e4f-8326-7b249ec5988e req-352c401a-0415-469c-9201-2978acb28647 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.1447380
Jun 01 18:50:44.988869 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-226a5438-52d8-4e4f-8326-7b249ec5988e req-dbd86002-0bd4-4b5b-aea3-8f1daf724fb1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379806
Jun 01 18:50:45.009757 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f400af5-6012-4b20-82b6-f2f4812f2058 req-8544c3a8-562e-40ff-8cf5-b74724a3fe8a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:45.011205 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3f400af5-6012-4b20-82b6-f2f4812f2058 req-8544c3a8-562e-40ff-8cf5-b74724a3fe8a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0785906
Jun 01 18:50:45.055649 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3f400af5-6012-4b20-82b6-f2f4812f2058 req-672c14c2-6198-4b41-84bd-af9fd607bf56 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389152
Jun 01 18:50:45.315871 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 00a066ed-ad86-4d31-9083-bf2f681a2c2c no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:45.353826 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 00a066ed-ad86-4d31-9083-bf2f681a2c2c {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:50:45.354178 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 00a066ed-ad86-4d31-9083-bf2f681a2c2c not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:50:45.466253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dac086-5f88-44e5-baff-d94df876c0db req-e40c774a-4234-43ab-99dd-81aa76bac978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:45.466877 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-50dac086-5f88-44e5-baff-d94df876c0db req-e40c774a-4234-43ab-99dd-81aa76bac978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:45.482760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-50dac086-5f88-44e5-baff-d94df876c0db req-e40c774a-4234-43ab-99dd-81aa76bac978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:45.483940 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-50dac086-5f88-44e5-baff-d94df876c0db req-e40c774a-4234-43ab-99dd-81aa76bac978 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.1604290
Jun 01 18:50:45.528005 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-50dac086-5f88-44e5-baff-d94df876c0db req-f5902e12-c7dc-4bc8-bfc5-e34c72a66754 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377092
Jun 01 18:50:46.174733 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f8bc57-734a-4aab-8d24-56d749dab9ad req-baf34c7d-f565-4ff3-854f-e539553583a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:46.176334 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f4f8bc57-734a-4aab-8d24-56d749dab9ad req-baf34c7d-f565-4ff3-854f-e539553583a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0825317
Jun 01 18:50:46.221284 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f4f8bc57-734a-4aab-8d24-56d749dab9ad req-49d5b3e4-5b48-4503-a73d-2b3d73a75a78 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394039
Jun 01 18:50:46.253429 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3afbbdf-dfae-4011-a6d9-c5b090015294 req-3661e0f0-2c99-42ef-86fa-3ddfdc57d834 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:46.254852 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b3afbbdf-dfae-4011-a6d9-c5b090015294 req-3661e0f0-2c99-42ef-86fa-3ddfdc57d834 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.0810328
Jun 01 18:50:46.300823 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b3afbbdf-dfae-4011-a6d9-c5b090015294 req-60ab41a4-a5a9-4d6a-846d-4f8ed5215e6e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402939
Jun 01 18:50:46.703099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5be18b9f-d282-48a8-a2ba-16ef94f589fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:46.729411 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9556479-4dfd-49de-8596-7964db9a4557 req-2c812b44-f228-4bc0-83c8-e909f2911945 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:46.730875 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9556479-4dfd-49de-8596-7964db9a4557 req-2c812b44-f228-4bc0-83c8-e909f2911945 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.0971124
Jun 01 18:50:46.776385 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f9556479-4dfd-49de-8596-7964db9a4557 req-f6ca1a40-db94-415a-9d68-7c1038de4c6a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396121
Jun 01 18:50:46.850652 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:47.325597 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:50:47.410142 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e021e0e2-7656-4f08-9cad-03dba6768f5d req-50742e87-9518-43b0-ad54-2596015809f0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:47.411660 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e021e0e2-7656-4f08-9cad-03dba6768f5d req-50742e87-9518-43b0-ad54-2596015809f0 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0815508
Jun 01 18:50:47.457408 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e021e0e2-7656-4f08-9cad-03dba6768f5d req-4f164a6a-3f95-4d03-950e-9099b0a01d03 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391469
Jun 01 18:50:47.463703 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:47.479826 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'mac_address': 'fa:16:3e:6b:40:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:50:47.511973 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274f7742-b8ed-4306-aac0-38315f713311 req-956fa6e5-4db5-4a68-87b7-e56b1119411a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:47.524099 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-274f7742-b8ed-4306-aac0-38315f713311 req-956fa6e5-4db5-4a68-87b7-e56b1119411a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 943 time: 0.1012876
Jun 01 18:50:47.538808 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:47.558560 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:50:47.570624 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-274f7742-b8ed-4306-aac0-38315f713311 req-99a74de3-15ad-49ca-9e7a-0a52fb6e4ddd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453241
Jun 01 18:50:47.575528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:47.579922 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:47.582016 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:47.655284 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=9']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:47.659358 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:47.790005 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-e5e09bab-0443-4ffd-9aaf-3fe0acafa959 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:47.791538 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-e5e09bab-0443-4ffd-9aaf-3fe0acafa959 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.0904486
Jun 01 18:50:47.802749 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:47.913132 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:47.959465 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Deleting port 7a59828a-57a1-4f2b-9392-36cb6d568256 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:50:47.959814 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:48.106123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4214053f-9b16-4ce4-8c8c-7192a12243d4 req-80184dca-c721-406c-9810-2a1cc4fa83d8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:48.116385 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4214053f-9b16-4ce4-8c8c-7192a12243d4 req-80184dca-c721-406c-9810-2a1cc4fa83d8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 945 time: 0.2199273
Jun 01 18:50:48.120190 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] For port 7a59828a-57a1-4f2b-9392-36cb6d568256, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=7a59828a-57a1-4f2b-9392-36cb6d568256,segment=NetworkSegment(8aee0e97-a508-4a4c-9292-a97cd5317182),segment_id=8aee0e97-a508-4a4c-9292-a97cd5317182)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:48.120672 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:48.183660 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4214053f-9b16-4ce4-8c8c-7192a12243d4 req-53861d43-bdaf-435c-a3ca-ee32526c18d9 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/security-groups?id=ad53f3e9-ca04-4913-841a-9a016a059a79&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0636747
Jun 01 18:50:48.267703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Calling delete_port for 7a59828a-57a1-4f2b-9392-36cb6d568256 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:50:48.356298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79365bf0-4c14-48dc-8575-7e85e0fdaa23 req-2c62cef5-ce5a-407b-af31-bdb14758e2a8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:48.363816 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-79365bf0-4c14-48dc-8575-7e85e0fdaa23 req-2c62cef5-ce5a-407b-af31-bdb14758e2a8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.0936711
Jun 01 18:50:48.390043 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:48.399614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f3eef378-57e8-4b53-a6ca-6a84b561c057 tempest-DeleteServersTestJSON-108655113 tempest-DeleteServersTestJSON-108655113-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:48.405716 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-79365bf0-4c14-48dc-8575-7e85e0fdaa23 req-4e44a775-8f56-4468-a4a1-229fce621df0 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410490
Jun 01 18:50:48.431177 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36954) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:48.450202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Pushing event deleted for resources: {'Port': ['ID=7a59828a-57a1-4f2b-9392-36cb6d568256,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:48.452790 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:48.534506 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] No DVR routers for this DVR port 7a59828a-57a1-4f2b-9392-36cb6d568256 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:50:48.537122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:48.540994 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'name': 'network-vif-deleted', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:48.543309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e38a0dd-6843-4595-8660-554bacdacccc" -d '{"events": [{"server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "name": "network-vif-deleted", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:48.555179 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d78959bd-1990-4a69-a795-0530f3a4e5ee req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.25 "DELETE /v2.0/ports/7a59828a-57a1-4f2b-9392-36cb6d568256 HTTP/1.1" status: 204  len: 173 time: 0.7536037
Jun 01 18:50:48.592244 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17fcd1a4-4855-4a37-9f8d-ceef8c42b652 x-openstack-request-id: req-17fcd1a4-4855-4a37-9f8d-ceef8c42b652 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:48.592603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7e76531-2327-4dc3-b694-5027dd117eb0", "name": "network-vif-deleted", "tag": "7a59828a-57a1-4f2b-9392-36cb6d568256", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:48.592902 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-17fcd1a4-4855-4a37-9f8d-ceef8c42b652 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:48.593433 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7e76531-2327-4dc3-b694-5027dd117eb0', 'name': 'network-vif-deleted', 'tag': '7a59828a-57a1-4f2b-9392-36cb6d568256', 'status': 'completed', 'code': 200}
Jun 01 18:50:48.690378 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7419bf25-6c1d-426c-b9fd-451a93ed904a tempest-TestMinimumBasicScenario-1949145632 tempest-TestMinimumBasicScenario-1949145632-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:48.691314 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7419bf25-6c1d-426c-b9fd-451a93ed904a tempest-TestMinimumBasicScenario-1949145632 tempest-TestMinimumBasicScenario-1949145632-project-admin] Synchronizing usage tracker for tenant:742cd095d98847558adeaa435437024e on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:48.758972 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7419bf25-6c1d-426c-b9fd-451a93ed904a tempest-TestMinimumBasicScenario-1949145632 tempest-TestMinimumBasicScenario-1949145632-project-admin] Unset dirty status for tenant:742cd095d98847558adeaa435437024e on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:48.760133 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7419bf25-6c1d-426c-b9fd-451a93ed904a tempest-TestMinimumBasicScenario-1949145632 tempest-TestMinimumBasicScenario-1949145632-project-admin] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1093 time: 0.3279359
Jun 01 18:50:48.763472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 36962) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:48.773454 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'port_id': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'fixed_ip_address': '172.20.0.9'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:48.779951 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:48.785130 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:floatingip and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:48.788234 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:48.794744 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:48.795981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e962703-ae12-4694-a7f7-ff6b324af975 req-afa3e1be-9adf-49c1-8159-338a1c27e585 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:48.797469 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4e962703-ae12-4694-a7f7-ff6b324af975 req-afa3e1be-9adf-49c1-8159-338a1c27e585 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 944 time: 0.1017821
Jun 01 18:50:48.805960 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for floatingip, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:48.843175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['7a59828a-57a1-4f2b-9392-36cb6d568256'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:48.845750 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4e962703-ae12-4694-a7f7-ff6b324af975 req-59152045-0d89-4541-a282-93138f318873 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418200
Jun 01 18:50:48.950472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.086403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Allocated IP 172.27.0.140 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/98a229be-fab5-47f5-82cb-67fb032f2098) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:50:49.297673 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.326949 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:50:49.381422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.396817 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9ec1c77e-67a3-44a5-a222-d6cbbb1b49f1 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:49.412076 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:50:49.412483 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.432536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-fdea64c1-a342-466d-a3fd-6e0b405411a9 req-a77a8699-8556-4256-93d8-6fc2cfcfe679 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Synchronizing usage tracker for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:49.454826 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:50:49.464324 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:50:49.470762 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:50:49.502555 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-fdea64c1-a342-466d-a3fd-6e0b405411a9 req-a77a8699-8556-4256-93d8-6fc2cfcfe679 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Unset dirty status for tenant:ab05a0b11f6c4dc5b84c7c8e30bafa9d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:49.503708 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-fdea64c1-a342-466d-a3fd-6e0b405411a9 req-a77a8699-8556-4256-93d8-6fc2cfcfe679 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] 10.222.0.22 "GET /v2.0/ports?device_id=a7e76531-2327-4dc3-b694-5027dd117eb0 HTTP/1.1" status: 200  len: 210 time: 0.1623909
Jun 01 18:50:49.514247 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'Port': ['ID=98a229be-fab5-47f5-82cb-67fb032f2098,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:49.518879 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:49.561311 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.562444 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.599504 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:49.602746 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba22b941-6868-42f4-ba56-8a68a321eafa" -d '{"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:49.615196 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:49.622935 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:49.624676 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 7a59828a-57a1-4f2b-9392-36cb6d568256 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:49.669817 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-e18583f1-c5f5-48dd-866c-fee27f201245 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:49.776089 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36a5199c-b450-40bf-a6c1-530dcb028f62 x-openstack-request-id: req-36a5199c-b450-40bf-a6c1-530dcb028f62 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:49.776381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:49.777277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-36a5199c-b450-40bf-a6c1-530dcb028f62 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:49.777669 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'code': 200}
Jun 01 18:50:49.785006 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 7a59828a-57a1-4f2b-9392-36cb6d568256 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:50:49.785350 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 7a59828a-57a1-4f2b-9392-36cb6d568256 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:50:49.811880 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=10']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:49.815724 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:50.306577 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5326ec-1616-48ea-b809-36797689722f req-8fe87f38-4f67-4984-9585-9055aa81240a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:50.307994 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6d5326ec-1616-48ea-b809-36797689722f req-8fe87f38-4f67-4984-9585-9055aa81240a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.3032966
Jun 01 18:50:50.350768 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.399822 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8231c989-2681-4f20-a55e-b989b0685a62 req-299d453b-2ac7-47db-a6ec-7bdb8b4a49be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:50.401264 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8231c989-2681-4f20-a55e-b989b0685a62 req-299d453b-2ac7-47db-a6ec-7bdb8b4a49be service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 1099 time: 0.2007654
Jun 01 18:50:50.411612 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6d5326ec-1616-48ea-b809-36797689722f req-2adc1c97-83d5-4934-bd5a-33a9be99a737 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0975132
Jun 01 18:50:50.493268 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8231c989-2681-4f20-a55e-b989b0685a62 req-95fbef2b-b6b9-497d-9538-ca40278d0033 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0807054
Jun 01 18:50:50.518577 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.613027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36988) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:50.685513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Deleting subnet b40008fb-ef5f-4ddd-be90-93c9dd2d5423 {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:50:50.695022 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.745296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.747555 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.750050 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.754576 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7f40f05b-f41a-4e9a-8040-99390bd8c57d tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:50.807967 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:50.859461 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'Port': ['ID=98a229be-fab5-47f5-82cb-67fb032f2098,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:50.867888 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:50.887131 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.134562 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.146253 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c09c14-14be-4eec-8379-44df7fb298a8 req-04405557-a2a3-48d5-ab38-0cfe640aaff2 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:51.147982 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-16c09c14-14be-4eec-8379-44df7fb298a8 req-04405557-a2a3-48d5-ab38-0cfe640aaff2 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1446228
Jun 01 18:50:51.149877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dd285007-b549-412e-ae17-78607d08edb3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:51.153051 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Floating IP bd83f58c-ab91-47f9-a413-2b0d622fc6e0 associated. External IP: 172.27.0.140, port: 57350594-9e66-45d7-9d43-cd9828eb72bb.
Jun 01 18:50:51.209961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.216129 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b40008fb-ef5f-4ddd-be90-93c9dd2d5423,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:51.222712 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:51.245340 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-36fa4242-cd90-46da-b339-3077e5e8e3f7 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/b40008fb-ef5f-4ddd-be90-93c9dd2d5423 HTTP/1.1" status: 204  len: 168 time: 0.6311944
Jun 01 18:50:51.250228 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-16c09c14-14be-4eec-8379-44df7fb298a8 req-ae177de7-0d35-44b4-a712-cffc3d17ec47 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0650651
Jun 01 18:50:51.250676 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 36994) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:51.355552 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.483853 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.496976 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd5db6a0>,) {'filters': {'network_id': ['2bc7607a-0e83-4423-b9b7-ac3e13607a13']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:51.510956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd5db6a0>, '8aee0e97-a508-4a4c-9292-a97cd5317182') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:51.511250 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd5db6a0>, '8aee0e97-a508-4a4c-9292-a97cd5317182') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:51.516591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Router dd23659b-80fb-4c76-accf-8fae6eeb1c47 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:50:51.524516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.542715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.554935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Releasing vlan 92 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:50:51.555612 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:50:51.572609 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:50:51.732455 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.737431 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78173034-8d11-4068-b3c6-675a5a7db23b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:51.757932 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.765292 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Pushing event deleted for resources: {'Network': ['ID=2bc7607a-0e83-4423-b9b7-ac3e13607a13,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:51.770280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:51.783296 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] 10.222.0.22 "DELETE /v2.0/networks/2bc7607a-0e83-4423-b9b7-ac3e13607a13 HTTP/1.1" status: 204  len: 168 time: 0.5308619
Jun 01 18:50:51.792368 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:50:51.804699 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Sync routers for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:50:51.818365 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea64243-6664-4dbc-bc5b-8a9ee55eb4e5 req-769a1235-1cb2-4ff3-a563-08219d8458f7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:51.819845 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cea64243-6664-4dbc-bc5b-8a9ee55eb4e5 req-769a1235-1cb2-4ff3-a563-08219d8458f7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.2298667
Jun 01 18:50:51.820854 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:50:51.821824 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cddeb8e0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:50:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:51.832243 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:51.937360 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.1724310
Jun 01 18:50:51.940416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:51.942656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37034) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:51.942783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65110717-0bf0-4e0f-9794-1e647bd25b2d" -d '{"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:51.948713 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cea64243-6664-4dbc-bc5b-8a9ee55eb4e5 req-12ca2782-306d-40c2-967d-9c4685c83735 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0780175
Jun 01 18:50:51.955419 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-259401608', 'description': 'tempest-secgroup-smoke-259401608 description', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:51.972958 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:52.001771 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:52.023785 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.064311 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74f732da-bcc0-4405-92ad-912500fbe349 x-openstack-request-id: req-74f732da-bcc0-4405-92ad-912500fbe349 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:52.065296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:52.065296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-74f732da-bcc0-4405-92ad-912500fbe349 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:52.067134 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:50:52.071605 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:50:52.072989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:52.079746 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:52.083559 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:52.093879 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:52.155902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37046) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:52.218091 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1b43a5dc-36d2-480a-b789-ecff14cb616b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ab05a0b11f6c4dc5b84c7c8e30bafa9d&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0608695
Jun 01 18:50:52.219883 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37048) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:52.324870 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-70c27440-23de-49d0-ab08-de9cf27f463c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.326983 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-70c27440-23de-49d0-ab08-de9cf27f463c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1098 time: 0.2168131
Jun 01 18:50:52.343602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.369378 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.378317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e884678d-f9e9-4ea1-a45b-85c57aa24ec3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:52.391484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb95961-7738-4b60-880f-a7f2bc269368 req-18f81d3b-12c1-446e-89bf-94d16e87d4e3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.398690 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1bb95961-7738-4b60-880f-a7f2bc269368 req-18f81d3b-12c1-446e-89bf-94d16e87d4e3 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1438975
Jun 01 18:50:52.474431 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.483594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.488186 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.5440531
Jun 01 18:50:52.490012 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37052) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:52.501016 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1bb95961-7738-4b60-880f-a7f2bc269368 req-aa939232-0be4-4d8c-979e-5728131f4755 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1013987
Jun 01 18:50:52.507993 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cddeb8e0>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': 'bd83f58c-ab91-47f9-a413-2b0d622fc6e0', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'floating_ip_address': '172.27.0.140', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'port_id': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 383, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'mac_address': 'fa:16:3e:9a:1f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:50:49Z', 'updated_at': '2021-06-01T18:50:49Z', 'revision_number': 0, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:52.518053 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:52.518224 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Checking router: dd23659b-80fb-4c76-accf-8fae6eeb1c47 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:50:52.518665 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroup': ['ID=65806fab-dac4-417e-928f-3c5c209394ed,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:52.522245 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:52.524474 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:50:52.525100 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cddeb8e0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:50:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:52.529540 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:52.548911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:52.555748 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:52.567015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-b1f86802-c6b7-487d-9a37-54442644adbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.567562 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.569334 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-b1f86802-c6b7-487d-9a37-54442644adbc service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.2340786
Jun 01 18:50:52.577697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:52.630887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d28da030-00f8-42ec-b30a-76d63885e18f req-b2cb49a9-5de7-4747-b59b-c236bda82588 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.632697 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d28da030-00f8-42ec-b30a-76d63885e18f req-b2cb49a9-5de7-4747-b59b-c236bda82588 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.2068346
Jun 01 18:50:52.633861 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.698308 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-223aabef-8813-4959-8f88-4a421f87b9e9 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 999 time: 0.1178312
Jun 01 18:50:52.717859 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.723661 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8cb3a232-a5c9-4db3-9807-7eb702bb735e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:52.732658 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d28da030-00f8-42ec-b30a-76d63885e18f req-80715fb4-e59e-4eab-8423-e3acd790d834 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0885079
Jun 01 18:50:52.748558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad53f3e9-ca04-4913-841a-9a016a059a79,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:52.754866 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:50:52.755616 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.765795 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:52.775368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.780456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-882872f7-531f-4c5a-bc2a-3a54d95bc462 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:52.793616 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.797047 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ad53f3e9-ca04-4913-841a-9a016a059a79 HTTP/1.1" status: 204  len: 168 time: 0.5738924
Jun 01 18:50:52.797202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-a3d2036b-3e5a-4275-a4f2-aaa062a7babd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.800884 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-a3d2036b-3e5a-4275-a4f2-aaa062a7babd service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.0915673
Jun 01 18:50:52.806898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f281818-b557-4888-88b9-3ad5b002c743,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:52.810835 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:52.814645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.819448 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3225601
Jun 01 18:50:52.820201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37056) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:52.825527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:52.831562 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:52.835934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:52.839078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:52.845783 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:52.864829 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.896180 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-647661e3-c749-47e9-821b-9c639f2d8843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:52.898481 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-647661e3-c749-47e9-821b-9c639f2d8843 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0900958
Jun 01 18:50:52.937855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.942638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.944951 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:52.968778 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=123ab1f3-df39-4bb3-a4a0-55d32757b174,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:52.972028 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:52.983494 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:52.987993 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1667290
Jun 01 18:50:52.988877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37058) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:52.993921 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:53.000510 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:53.006679 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:53.009862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:53.017710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:53.041850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.127226 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.135633 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.138539 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:53.173436 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dbc305d4-a1f9-4ee0-a754-dfcfd4212580,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:53.176863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:53.178326 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cddeb8e0>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': 'bd83f58c-ab91-47f9-a413-2b0d622fc6e0', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'floating_ip_address': '172.27.0.140', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'port_id': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 383, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'mac_address': 'fa:16:3e:9a:1f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:50:49Z', 'updated_at': '2021-06-01T18:50:49Z', 'revision_number': 0, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:50:53.183500 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b785358f-7766-40a1-a29d-9f9341d5d679 None None] The sync data for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi is: [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': 'bd83f58c-ab91-47f9-a413-2b0d622fc6e0', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'floating_ip_address': '172.27.0.140', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'port_id': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 383, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'mac_address': 'fa:16:3e:9a:1f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:50:49Z', 'updated_at': '2021-06-01T18:50:49Z', 'revision_number': 0, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:50:53.190998 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.198235 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2079511
Jun 01 18:50:53.199358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37064) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:53.208186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:53.215617 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:53.222173 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:53.226251 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:53.237383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:53.255139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.288199 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-0317763a-41b3-4d90-888b-d99a8ed38998 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3800042
Jun 01 18:50:53.330204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.335914 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.338587 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bb2966cb-bc0f-4ee2-9112-1997aef7ca51 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:53.366740 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7310343a-9bea-4227-abfd-a789e63b3db8,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:53.372278 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:53.382524 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.384635 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-56be9c6f-67ab-4c98-b3d0-9995b06aa471 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1837051
Jun 01 18:50:53.387047 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37074) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:53.392521 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:53.402646 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:53.408875 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:53.412791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:53.419989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:53.434571 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.securitygroups_db [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Project 35f75df4cb564b1dad14fd0d02d3c46b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:50:53.442626 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.507323 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53a3994b-7239-48df-ac36-b411f182d070 None None] New status for floating IP bd83f58c-ab91-47f9-a413-2b0d622fc6e0: ACTIVE {{(pid=98260) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:50:53.510749 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-65110717-0bf0-4e0f-9794-1e647bd25b2d req-580ea612-acea-44b4-a7ea-20dac44790c4 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1837745
Jun 01 18:50:53.524867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.537015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28c0376-5862-400f-b549-60dc64a28be8 req-6c28cdaf-23a0-477d-9cf4-3b3243b17a79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:53.538935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.539700 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b28c0376-5862-400f-b549-60dc64a28be8 req-6c28cdaf-23a0-477d-9cf4-3b3243b17a79 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.2537234
Jun 01 18:50:53.544924 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:53.575447 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=537ab14d-ecf4-4ba2-9b48-0d67672affb7,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:53.582069 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:53.607182 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b28c0376-5862-400f-b549-60dc64a28be8 req-c9d0ca92-9e96-4378-85c4-c3ab0d348b48 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0613921
Jun 01 18:50:53.613074 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.617085 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-70b0d1ed-5e4f-4e81-827b-5321e710c903 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2289722
Jun 01 18:50:53.617242 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37082) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:53.622486 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'security_group_rule': {'security_group_id': '65806fab-dac4-417e-928f-3c5c209394ed', 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:53.640453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:53.640453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Usage tracker for resource:security_group_rule and tenant:35f75df4cb564b1dad14fd0d02d3c46b is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:53.640453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:53.652074 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:53.665161 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.securitygroups_db [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Project 35f75df4cb564b1dad14fd0d02d3c46b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:50:53.674417 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.777614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.779893 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf4f016-1f5e-45f0-9751-098db87e661e req-4c3e5ba5-762d-4834-8bde-834257815ed4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:53.783426 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.786078 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:53.789730 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-edf4f016-1f5e-45f0-9751-098db87e661e req-4c3e5ba5-762d-4834-8bde-834257815ed4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.1306040
Jun 01 18:50:53.814830 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f96ba3c5-cd1b-4e22-b497-2bba65ed3844,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:53.824521 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:53.830721 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:53.835394 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-1bf19712-29a8-4536-b326-72bdf798b62b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.2169316
Jun 01 18:50:53.853485 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-edf4f016-1f5e-45f0-9751-098db87e661e req-70768aec-62b1-48e3-93f3-54d88db469b4 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0607200
Jun 01 18:50:54.001751 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-495d1d9f-3c55-4435-a154-76531868c02e req-66bb1cf5-a863-46f0-a243-b01463614757 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:50:54.002045 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e65fcb-2829-4967-ba19-fc7ce77722d5 req-4bf674d3-4ef6-4e04-a21f-4d3c0404f88d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:54.003603 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-90e65fcb-2829-4967-ba19-fc7ce77722d5 req-4bf674d3-4ef6-4e04-a21f-4d3c0404f88d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0872998
Jun 01 18:50:54.018360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-495d1d9f-3c55-4435-a154-76531868c02e req-66bb1cf5-a863-46f0-a243-b01463614757 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:50:54.019513 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-495d1d9f-3c55-4435-a154-76531868c02e req-66bb1cf5-a863-46f0-a243-b01463614757 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-259401608&fields=id&tenant_id=35f75df4cb564b1dad14fd0d02d3c46b HTTP/1.1" status: 200  len: 267 time: 0.0632319
Jun 01 18:50:54.057244 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-90e65fcb-2829-4967-ba19-fc7ce77722d5 req-c5d0bf15-9393-4e0e-8053-4882ca5e7442 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0471616
Jun 01 18:50:54.119811 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495d1d9f-3c55-4435-a154-76531868c02e req-df625be8-e3f1-4c5d-9c4d-71b9eca40b9b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:54.121343 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-495d1d9f-3c55-4435-a154-76531868c02e req-df625be8-e3f1-4c5d-9c4d-71b9eca40b9b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.0928578
Jun 01 18:50:54.132764 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'port': {'security_groups': ['9ec7d009-a5f3-4e97-b404-46080b7ac538', '65806fab-dac4-417e-928f-3c5c209394ed']}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:50:54.260475 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:54.528064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:54.555949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:54.561082 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:54.567098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48024cb7-7cef-4d68-a350-4c48bff5f74f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:54.573040 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:54.649206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:54.649929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:54.651643 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-495d1d9f-3c55-4435-a154-76531868c02e req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "PUT /v2.0/ports/57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 981 time: 0.5233581
Jun 01 18:50:54.656022 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:54.659808 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd" -d '{"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:54.668638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=6']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:54.671965 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:54.755695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1815c16-eba8-48af-a860-17e4d1170240 x-openstack-request-id: req-a1815c16-eba8-48af-a860-17e4d1170240 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:54.756094 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:54.756672 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-a1815c16-eba8-48af-a860-17e4d1170240 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:54.756996 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:50:54.759122 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:55.035708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f62d46b-147f-4f1b-8b15-a415240fc636 req-406c2409-8644-436f-b1a3-638d2953ac48 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.038204 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f62d46b-147f-4f1b-8b15-a415240fc636 req-406c2409-8644-436f-b1a3-638d2953ac48 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.1964765
Jun 01 18:50:55.048543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-677b6ec6-20c6-4380-95b3-fe1fe76af306 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.050365 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-677b6ec6-20c6-4380-95b3-fe1fe76af306 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.2057083
Jun 01 18:50:55.083815 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0020ae3b-e8ee-45e7-83e6-83adead2a7b6 req-003ca53c-7769-4b76-bf20-a1ccc9ccd5c1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.086789 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0020ae3b-e8ee-45e7-83e6-83adead2a7b6 req-003ca53c-7769-4b76-bf20-a1ccc9ccd5c1 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 945 time: 0.0962763
Jun 01 18:50:55.092728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-3989b3ed-059e-4bbe-a9d9-41e26143fb07 None None] Provisioning complete for port 57350594-9e66-45d7-9d43-cd9828eb72bb triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:50:55.093402 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3989b3ed-059e-4bbe-a9d9-41e26143fb07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:55.136226 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0020ae3b-e8ee-45e7-83e6-83adead2a7b6 req-7fc4c199-40ad-47a1-85d0-f69a795d19e2 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429339
Jun 01 18:50:55.150381 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-c351eb80-8f0c-455f-9c50-09acdbbc51f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.151867 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-c351eb80-8f0c-455f-9c50-09acdbbc51f1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1137 time: 0.3620517
Jun 01 18:50:55.168774 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7f62d46b-147f-4f1b-8b15-a415240fc636 req-2140932e-40c8-4851-81cf-b0872033dc32 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1161573
Jun 01 18:50:55.350010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e16e81-8696-4872-b9f4-687f3a97c5e9 req-d4fe4fdb-9209-4d68-be59-494d20a8c0b4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.351678 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-92e16e81-8696-4872-b9f4-687f3a97c5e9 req-d4fe4fdb-9209-4d68-be59-494d20a8c0b4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0863011
Jun 01 18:50:55.412371 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-92e16e81-8696-4872-b9f4-687f3a97c5e9 req-1a229703-d266-4804-96ef-8f51a3d7c5d5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0536027
Jun 01 18:50:55.414958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-2e98a87c-c1a5-4db0-a209-76866b3e62fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.416392 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-2e98a87c-c1a5-4db0-a209-76866b3e62fe service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.2393997
Jun 01 18:50:55.431482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Deleting port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:50:55.431828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:55.624888 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-3197266f-bc86-482c-bc87-51207ac12d78 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 1001 time: 0.1955054
Jun 01 18:50:55.694943 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] For port 176d8ea4-da6f-4ccc-b7e0-f05371988c98, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=176d8ea4-da6f-4ccc-b7e0-f05371988c98,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:50:55.695298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:55.827393 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Calling delete_port for 176d8ea4-da6f-4ccc-b7e0-f05371988c98 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:50:55.838899 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-78c0d904-c6ee-4987-a264-cba790a3c3be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.840317 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-78c0d904-c6ee-4987-a264-cba790a3c3be service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.1885834
Jun 01 18:50:55.939389 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-fe9f260e-f82c-4e40-9675-7887aff23d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:55.940876 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-fe9f260e-f82c-4e40-9675-7887aff23d7b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0900269
Jun 01 18:50:56.174465 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:56.181127 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:56.186604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['b54280f9-3b4c-49b4-b5a4-610e3328b1af'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:50:56.237462 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Pushing event deleted for resources: {'Port': ['ID=176d8ea4-da6f-4ccc-b7e0-f05371988c98,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:56.243088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:56.278997 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-fd57fe2f-6f00-41ef-97ab-4389511150aa service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3102770
Jun 01 18:50:56.374162 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8c3f81de-3f31-4a51-80eb-4f89047ddeb3 req-b21d530c-db7a-4902-a400-1bac6590213e tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=90f94098-7c5c-4c76-a25d-dfaa895013ff HTTP/1.1" status: 200  len: 210 time: 0.0981293
Jun 01 18:50:56.382539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] No DVR routers for this DVR port 176d8ea4-da6f-4ccc-b7e0-f05371988c98 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:50:56.386710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:56.389192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'name': 'network-vif-deleted', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:50:56.391936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ff8730a-f267-46d8-80f7-4bb3fcfd1348" -d '{"events": [{"server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "name": "network-vif-deleted", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:50:56.460669 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:50:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-914adc58-d6fb-4a02-8c64-d9ac3639c40b x-openstack-request-id: req-914adc58-d6fb-4a02-8c64-d9ac3639c40b {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:50:56.460987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90f94098-7c5c-4c76-a25d-dfaa895013ff", "name": "network-vif-deleted", "tag": "176d8ea4-da6f-4ccc-b7e0-f05371988c98", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:50:56.461264 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-914adc58-d6fb-4a02-8c64-d9ac3639c40b {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:50:56.461678 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90f94098-7c5c-4c76-a25d-dfaa895013ff', 'name': 'network-vif-deleted', 'tag': '176d8ea4-da6f-4ccc-b7e0-f05371988c98', 'status': 'completed', 'code': 200}
Jun 01 18:50:56.467046 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d61ba43a-a224-4b22-a07d-75d940d247a9 req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "DELETE /v2.0/ports/176d8ea4-da6f-4ccc-b7e0-f05371988c98 HTTP/1.1" status: 204  len: 173 time: 1.3825767
Jun 01 18:50:56.505864 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bef3fdc4-870b-4bc1-a1f0-1525d71bcccd req-7027042d-53b5-4957-93b7-9846d0896ee1 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1900992
Jun 01 18:50:56.616116 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d9c313-8329-4377-b404-2711a3c371db req-3b2adc4b-a510-4b70-9f11-f64464933b1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:56.617290 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a6d9c313-8329-4377-b404-2711a3c371db req-3b2adc4b-a510-4b70-9f11-f64464933b1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0892985
Jun 01 18:50:56.665296 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a6d9c313-8329-4377-b404-2711a3c371db req-fb34731b-2a10-4f8e-b491-4a427462ae20 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410521
Jun 01 18:50:57.337329 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 176d8ea4-da6f-4ccc-b7e0-f05371988c98 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:50:57.372264 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 176d8ea4-da6f-4ccc-b7e0-f05371988c98 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:50:57.372659 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 176d8ea4-da6f-4ccc-b7e0-f05371988c98 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:50:57.838107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacc2932-b27c-4f18-b40b-92b4cf5c1a5f req-01d6e808-3954-4d4d-9032-3235c7d7889a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:57.839733 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dacc2932-b27c-4f18-b40b-92b4cf5c1a5f req-01d6e808-3954-4d4d-9032-3235c7d7889a tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0884302
Jun 01 18:50:57.858929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ffefa6-e178-419b-a81d-9bd12c48d6b4 req-6e305777-f005-4387-b207-f2a409264c96 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:57.861234 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f0ffefa6-e178-419b-a81d-9bd12c48d6b4 req-6e305777-f005-4387-b207-f2a409264c96 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0870960
Jun 01 18:50:57.889309 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dacc2932-b27c-4f18-b40b-92b4cf5c1a5f req-13f7e5da-d923-4b11-ad35-d666e66bb64f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437233
Jun 01 18:50:57.905884 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f0ffefa6-e178-419b-a81d-9bd12c48d6b4 req-4fc95230-b5e3-4d72-b272-bd1187116053 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391738
Jun 01 18:50:59.072348 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37176) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:59.089350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791399b6-fdd5-4438-a4b0-081c805ce8a9 req-b1e92c84-c4c7-46b9-93a8-7462aa5ba6a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:59.090825 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-791399b6-fdd5-4438-a4b0-081c805ce8a9 req-b1e92c84-c4c7-46b9-93a8-7462aa5ba6a8 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0943530
Jun 01 18:50:59.101153 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afe67e2-5c0c-491c-acdd-2311a407ef94 req-bd1bbf52-8d0d-4405-96e8-1b1315327234 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:50:59.107893 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9afe67e2-5c0c-491c-acdd-2311a407ef94 req-bd1bbf52-8d0d-4405-96e8-1b1315327234 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0930986
Jun 01 18:50:59.149534 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9afe67e2-5c0c-491c-acdd-2311a407ef94 req-ee7ed5cb-b49f-4af8-8cd9-cce387e1e14d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406861
Jun 01 18:50:59.207002 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.231399 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:59.238772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Usage tracker for resource:security_group_rule and tenant:796edcce78584b7bb3521f9ffe136bf7 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:59.243692 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-791399b6-fdd5-4438-a4b0-081c805ce8a9 req-55095dde-bc65-40ee-8a0a-fdb693d6d17c tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1460438
Jun 01 18:50:59.244476 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:59.251583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:59.331287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.334766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.342335 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-91488fcc-f899-4ed2-950b-6885912bcf54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:59.381453 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=796edcce78584b7bb3521f9ffe136bf7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3080096
Jun 01 18:50:59.383009 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8aef5db9-127c-4f74-8d30-70320ac6a830,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:59.384101 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37180) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:59.386080 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:59.439886 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.463950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.515016 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.518520 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:59.529937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8aef5db9-127c-4f74-8d30-70320ac6a830,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:59.533881 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:50:59.536972 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.538063 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/8aef5db9-127c-4f74-8d30-70320ac6a830 HTTP/1.1" status: 204  len: 168 time: 0.1529610
Jun 01 18:50:59.815199 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37186) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:59.832326 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.849585 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:50:59.853298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Usage tracker for resource:security_group_rule and tenant:32d0343c75e646aeb077d7a9148483a9 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:50:59.856005 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:50:59.862252 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:50:59.942517 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.947015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:50:59.955601 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-b9d4063d-9515-489d-93da-a6f560e786e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:50:59.993592 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=32d0343c75e646aeb077d7a9148483a9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1773121
Jun 01 18:50:59.995169 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68b5287f-5e57-45dd-a76d-b0eea6d29181,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:50:59.996212 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37188) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:50:59.998140 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:00.058140 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:00.083028 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:00.132670 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:00.136204 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-490ef280-f491-46e7-8e47-4f6cc07c1a63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:00.147252 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68b5287f-5e57-45dd-a76d-b0eea6d29181,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:00.151864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:00.153648 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:00.154729 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-67aab6d8-bff9-441d-9fde-5aa6aa073132 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/68b5287f-5e57-45dd-a76d-b0eea6d29181 HTTP/1.1" status: 204  len: 168 time: 0.1575222
Jun 01 18:51:00.341889 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c025b38-d8e4-40a5-9fce-694eec3045cd req-53ea00f7-4636-4dcb-91bc-e43ee0377140 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:00.343823 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8c025b38-d8e4-40a5-9fce-694eec3045cd req-53ea00f7-4636-4dcb-91bc-e43ee0377140 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0850039
Jun 01 18:51:00.393929 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8c025b38-d8e4-40a5-9fce-694eec3045cd req-24c66920-0585-45d3-a3f6-6d7e00da5862 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441377
Jun 01 18:51:00.445902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd35334-1332-4d66-92fd-910d35e1440e req-4f1ac527-e9f8-4ec9-a750-0e3c33c940d5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:00.447369 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0dd35334-1332-4d66-92fd-910d35e1440e req-4f1ac527-e9f8-4ec9-a750-0e3c33c940d5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0897279
Jun 01 18:51:00.491437 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0dd35334-1332-4d66-92fd-910d35e1440e req-e8da337d-56c9-4e29-ad35-1384da947229 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382736
Jun 01 18:51:01.581286 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0484bccd-afd1-42e4-88b4-bf12cfb8773d req-50641e75-cf33-4ce6-bf8a-3453e198fde3 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:01.582967 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0484bccd-afd1-42e4-88b4-bf12cfb8773d req-50641e75-cf33-4ce6-bf8a-3453e198fde3 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0854051
Jun 01 18:51:01.633578 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0484bccd-afd1-42e4-88b4-bf12cfb8773d req-2028d540-c2bb-4129-98c1-02828062d829 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449150
Jun 01 18:51:01.705354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bb67b1-51bc-426a-80a3-58aa37e00a6e req-92dae196-fe18-4452-a1b1-1705bdf11b67 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:01.708922 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1bb67b1-51bc-426a-80a3-58aa37e00a6e req-92dae196-fe18-4452-a1b1-1705bdf11b67 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0970390
Jun 01 18:51:01.762449 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1bb67b1-51bc-426a-80a3-58aa37e00a6e req-02d8ddbd-c024-40d5-a2ce-85f7f4ebd01f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480809
Jun 01 18:51:02.006196 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc9ac85-1c65-450f-87ae-7bf7d8b8c070 req-6b2196d1-931e-497c-9d0a-83ed8af9b2fb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.009140 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6cc9ac85-1c65-450f-87ae-7bf7d8b8c070 req-6b2196d1-931e-497c-9d0a-83ed8af9b2fb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0900869
Jun 01 18:51:02.057198 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-34a1b31a-dd82-47c9-b21d-a0dff3ebd00f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.058056 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6cc9ac85-1c65-450f-87ae-7bf7d8b8c070 req-a690d403-f4b1-441d-9129-6702d86c3b54 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449274
Jun 01 18:51:02.059419 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-34a1b31a-dd82-47c9-b21d-a0dff3ebd00f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1099 time: 0.0851719
Jun 01 18:51:02.198909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-f3cb5ee9-062f-48b6-a5c8-bc4a9d8780b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.200351 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-f3cb5ee9-062f-48b6-a5c8-bc4a9d8780b5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.1333206
Jun 01 18:51:02.309764 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-377e0114-621d-465e-b3de-193c18a1e2b7 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 1001 time: 0.1002030
Jun 01 18:51:02.372799 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-f119f96d-7f40-465e-a7a5-e757a5e84da0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.374215 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-f119f96d-7f40-465e-a7a5-e757a5e84da0 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.0560348
Jun 01 18:51:02.447095 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-27d5f58a-1ed9-44e5-832b-770072e00ca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.448525 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-27d5f58a-1ed9-44e5-832b-770072e00ca2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0668867
Jun 01 18:51:02.657617 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-7e2904e8-9334-4e94-b4d0-7cfb07017dc8 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2006922
Jun 01 18:51:02.790466 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-02e6e5c5-ec08-4618-aa7d-e8bb272e4ee3 req-ee3b761a-6742-46c5-8423-1b1d0697c535 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1254590
Jun 01 18:51:02.941569 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f04ef28-b3aa-4cbf-bddb-51f96c634d80 req-17b72e01-effd-4d8e-b75d-1037a6fde02d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:02.942154 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-1f04ef28-b3aa-4cbf-bddb-51f96c634d80 req-17b72e01-effd-4d8e-b75d-1037a6fde02d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Synchronizing usage tracker for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:02.956529 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-1f04ef28-b3aa-4cbf-bddb-51f96c634d80 req-17b72e01-effd-4d8e-b75d-1037a6fde02d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Unset dirty status for tenant:25a97ba1c3dd49d0bba7b78bbfa71df1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:02.957806 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1f04ef28-b3aa-4cbf-bddb-51f96c634d80 req-17b72e01-effd-4d8e-b75d-1037a6fde02d tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0968697
Jun 01 18:51:03.001353 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1f04ef28-b3aa-4cbf-bddb-51f96c634d80 req-ae7176e3-70c0-470c-a71f-8d5f94f10485 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/security-groups?id=618cf6a3-a6b7-49d0-8c21-a5580355cfee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373101
Jun 01 18:51:03.244064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c414eeb-6517-4f73-80ef-7aeb2ab50284 req-b8b7a4da-fc36-4438-9d7d-b9ee271933dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:03.245483 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9c414eeb-6517-4f73-80ef-7aeb2ab50284 req-b8b7a4da-fc36-4438-9d7d-b9ee271933dd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0789931
Jun 01 18:51:03.297856 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9c414eeb-6517-4f73-80ef-7aeb2ab50284 req-62d6a046-f702-402a-bde4-9e199911732f tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0452316
Jun 01 18:51:03.520292 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-dcba661b-1622-4bf5-8867-238251b403bb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:03.521619 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-dcba661b-1622-4bf5-8867-238251b403bb tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 945 time: 0.0806928
Jun 01 18:51:03.658238 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Deleting port b54280f9-3b4c-49b4-b5a4-610e3328b1af {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:03.658919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:03.795714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] For port b54280f9-3b4c-49b4-b5a4-610e3328b1af, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b54280f9-3b4c-49b4-b5a4-610e3328b1af,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:51:03.796073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:03.919794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Calling delete_port for b54280f9-3b4c-49b4-b5a4-610e3328b1af owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:04.028969 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:04.034959 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1857728e-349a-431d-9b0b-dbbbcaf4abe5 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:04.041432 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['b54280f9-3b4c-49b4-b5a4-610e3328b1af'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:51:04.084138 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Pushing event deleted for resources: {'Port': ['ID=b54280f9-3b4c-49b4-b5a4-610e3328b1af,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:04.087503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:04.197105 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5457907e-118f-467f-823e-8f8202fb8084 req-7964f43e-7eb2-42b0-b4a7-d498044c691f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.22 "GET /v2.0/ports?device_id=efe28177-fcb1-4454-a8a0-94faa92a6060 HTTP/1.1" status: 200  len: 210 time: 0.0772438
Jun 01 18:51:04.197984 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] No DVR routers for this DVR port b54280f9-3b4c-49b4-b5a4-610e3328b1af on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:51:04.200442 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:04.203092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'name': 'network-vif-deleted', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:51:04.205361 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f121a1c3-ceff-4503-8177-660982fe77c2" -d '{"events": [{"server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "name": "network-vif-deleted", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:51:04.220106 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6679abdc-682a-47b9-a73f-d91bb50947ef req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] 10.222.0.25 "DELETE /v2.0/ports/b54280f9-3b4c-49b4-b5a4-610e3328b1af HTTP/1.1" status: 204  len: 173 time: 0.6916087
Jun 01 18:51:04.254118 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:51:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca0493bd-60ec-4f65-941b-6b1ddf3f9d59 x-openstack-request-id: req-ca0493bd-60ec-4f65-941b-6b1ddf3f9d59 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:51:04.254434 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "efe28177-fcb1-4454-a8a0-94faa92a6060", "name": "network-vif-deleted", "tag": "b54280f9-3b4c-49b4-b5a4-610e3328b1af", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:51:04.254708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-ca0493bd-60ec-4f65-941b-6b1ddf3f9d59 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:51:04.255121 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'efe28177-fcb1-4454-a8a0-94faa92a6060', 'name': 'network-vif-deleted', 'tag': 'b54280f9-3b4c-49b4-b5a4-610e3328b1af', 'status': 'completed', 'code': 200}
Jun 01 18:51:04.484209 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f230cf-fcc8-4cd4-8f00-b13048910925 req-50b92316-cab4-4520-9be8-bb04698a4b1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:04.485702 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-62f230cf-fcc8-4cd4-8f00-b13048910925 req-50b92316-cab4-4520-9be8-bb04698a4b1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0805192
Jun 01 18:51:04.528464 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-62f230cf-fcc8-4cd4-8f00-b13048910925 req-c749e366-0760-45d9-8fd7-3aebb6ae9d16 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0372419
Jun 01 18:51:05.292125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37286) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:05.820904 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.287277 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Deleting port 969881a4-e1be-405f-8d2a-24f457975526 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:06.287752 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.408646 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] For port 969881a4-e1be-405f-8d2a-24f457975526, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=969881a4-e1be-405f-8d2a-24f457975526,segment=NetworkSegment(69b1d8dc-90f3-4b2d-912f-ef992caee9a2),segment_id=69b1d8dc-90f3-4b2d-912f-ef992caee9a2)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:51:06.409341 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.534284 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Calling delete_port for 969881a4-e1be-405f-8d2a-24f457975526 owned by network:router_interface {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:06.710363 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37302) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:06.826200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.843581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:06.847943 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Usage tracker for resource:security_group_rule and tenant:8d80c1d92b6945e7832fd01b6b0df8e9 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:06.850743 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:06.856387 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:06.874619 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.878809 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:06.922429 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Pushing event deleted for resources: {'Port': ['ID=969881a4-e1be-405f-8d2a-24f457975526,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:06.925167 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:06.936244 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.939964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:06.948357 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b670fcf8-b738-4975-8235-86b89e7ff8b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:06.987765 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=8d80c1d92b6945e7832fd01b6b0df8e9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2763197
Jun 01 18:51:06.988680 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2579249-5320-4bf7-87d7-8ec31a402774,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:06.990790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37306) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:06.991609 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:07.129072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.223087 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.275119 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.373404 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.379395 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4fb15357-3494-4183-808c-f633db203754 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:07.395615 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b54280f9-3b4c-49b4-b5a4-610e3328b1af no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:51:07.429529 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: b54280f9-3b4c-49b4-b5a4-610e3328b1af {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:51:07.429874 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b54280f9-3b4c-49b4-b5a4-610e3328b1af not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:51:07.524789 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2579249-5320-4bf7-87d7-8ec31a402774,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:07.536195 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:07.569872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.570964 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/b2579249-5320-4bf7-87d7-8ec31a402774 HTTP/1.1" status: 204  len: 168 time: 0.5792630
Jun 01 18:51:07.752200 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Router efd33295-fb61-4e57-afa9-48097bd6e639 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:51:07.850375 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37312) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:07.867087 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.881471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:07.885249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Usage tracker for resource:security_group_rule and tenant:63813b4d21774483aae0fe71f594c593 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:07.887974 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:07.894274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:07.928986 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:51:07.936953 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] 10.222.0.22 "PUT /v2.0/routers/efd33295-fb61-4e57-afa9-48097bd6e639/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6407723
Jun 01 18:51:07.936953 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37314) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:07.944097 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Sync routers for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:51:07.955886 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:07.956723 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd97a520>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:50:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:07.984918 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.989539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:07.997711 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ca9cf25f-c489-4af9-89e4-2878f0c154f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:08.040608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db302cc4-0bfa-4d23-9630-fe5cbd45fd4d,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:08.047449 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=63813b4d21774483aae0fe71f594c593&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1959867
Jun 01 18:51:08.048366 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4cdd5e95-2d25-472e-8eac-c913ea984bde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:08.048832 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37316) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:08.113270 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.119522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks [] for router, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.143074 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.148112 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:08.197796 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.202890 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c038bba2-2a2e-463d-9cc4-571730651a42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:08.217554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db302cc4-0bfa-4d23-9630-fe5cbd45fd4d,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:08.220487 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:08.224586 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.228626 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/db302cc4-0bfa-4d23-9630-fe5cbd45fd4d HTTP/1.1" status: 204  len: 168 time: 0.1786726
Jun 01 18:51:08.294121 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.368321 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Deleting port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:08.368701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.462157 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd97a520>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7'}], 'enable_snat': True}, 'gw_port_id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:51:06Z', 'revision_number': 5, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port': {'id': 'f99b340a-953f-45e8-bbd2-57e0b5aa8a2b', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:a4:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.7', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:21Z', 'updated_at': '2021-06-01T18:47:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:08.466272 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Checking router: efd33295-fb61-4e57-afa9-48097bd6e639 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:51:08.476094 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Routers {'efd33295-fb61-4e57-afa9-48097bd6e639'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:08.476796 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd97a520>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:50:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['efd33295-fb61-4e57-afa9-48097bd6e639'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:08.495114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] For port f99b340a-953f-45e8-bbd2-57e0b5aa8a2b, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:51:08.495470 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.618858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Calling delete_port for f99b340a-953f-45e8-bbd2-57e0b5aa8a2b owned by network:router_gateway {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:08.636937 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] Set router efd33295-fb61-4e57-afa9-48097bd6e639 gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:08.748766 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd97a520>, [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:51:08Z', 'revision_number': 6, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:08.753158 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89a82ce-9e21-4a4d-a330-8eca6cda7a83 None None] The sync data for ids ['efd33295-fb61-4e57-afa9-48097bd6e639'] in dv-cinder-794021-1-iscsi is: [{'id': 'efd33295-fb61-4e57-afa9-48097bd6e639', 'name': 'tempest-ServerRescueNegativeTestJSON-1139431039-router', 'tenant_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:51:08Z', 'revision_number': 6, 'project_id': '25a97ba1c3dd49d0bba7b78bbfa71df1', 'gw_port_host': None}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:51:08.774281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:08.779656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db63d47c-fe5b-4a12-937e-4419af49cf7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:08.823587 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Pushing event deleted for resources: {'Port': ['ID=f99b340a-953f-45e8-bbd2-57e0b5aa8a2b,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:08.849504 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:08.920007 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.048560 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.100391 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37340) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:09.193728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.196200 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.215918 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1856438832-network', 'tenant_id': '398dbb1703f94d9c8306c0874e37445f'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:09.221426 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:09.225468 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Usage tracker for resource:network and tenant:398dbb1703f94d9c8306c0874e37445f is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:09.228397 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:09.234233 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:09.244752 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Made reservation on behalf of 398dbb1703f94d9c8306c0874e37445f for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:51:09.247054 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.258933 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.274913 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:09.279912 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Usage tracker for resource:security_group_rule and tenant:398dbb1703f94d9c8306c0874e37445f is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:09.282458 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.283013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Fanout notify agent at l3_agent the message router_deleted on router efd33295-fb61-4e57-afa9-48097bd6e639 {{(pid=98258) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:51:09.284414 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:09.291097 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:09.295749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.297105 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] 10.222.0.22 "DELETE /v2.0/routers/efd33295-fb61-4e57-afa9-48097bd6e639 HTTP/1.1" status: 204  len: 168 time: 1.3595436
Jun 01 18:51:09.299569 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37346) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:09.361938 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Deleting subnet e5e3f92a-adf7-40b8-b630-052c45a2db57 {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:51:09.365011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.391410 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.396940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.401499 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-36dea89a-292f-4c7d-af0a-a3844fd1db0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:09.416397 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.477513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.530848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80979052-1a11-4a0f-994d-206ebc515811,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:09.548258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:09.584220 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] vlan segment allocate from pool success with {'vlan_id': 56, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:51:09.606713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.607461 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Added segment cf13411a-f981-4c3d-a5a3-073f8015751c of type vlan for network 32a53b6b-2c02-410d-8524-e867e07e1dd4
Jun 01 18:51:09.646824 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.679054 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-17ac7d47-5aa9-499a-a9fc-5f9fce80dd50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:09.680580 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-17ac7d47-5aa9-499a-a9fc-5f9fce80dd50 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1137 time: 0.1264718
Jun 01 18:51:09.690572 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.692057 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:09.692838 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:09.699539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:09.826688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a2c5fc3-3b7f-47bf-9366-927ba073842b req-d8327797-bb64-4208-9ac6-91c04c37fc5a tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:09.829182 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7a2c5fc3-3b7f-47bf-9366-927ba073842b req-d8327797-bb64-4208-9ac6-91c04c37fc5a tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.2025950
Jun 01 18:51:09.844663 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.7428184
Jun 01 18:51:09.848052 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37350) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:09.871437 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Request body: {'subnet': {'network_id': '32a53b6b-2c02-410d-8524-e867e07e1dd4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1856438832-subnet', 'tenant_id': '398dbb1703f94d9c8306c0874e37445f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:09.876537 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:09.885353 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Usage tracker for resource:subnet and tenant:398dbb1703f94d9c8306c0874e37445f is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:09.890512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:09.900516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:09.902206 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Pushing event updated for resources: {'Network': ['ID=32a53b6b-2c02-410d-8524-e867e07e1dd4,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:09.906248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:09.914241 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 32a53b6b-2c02-410d-8524-e867e07e1dd4 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:51:09.935437 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7a2c5fc3-3b7f-47bf-9366-927ba073842b req-75dbd2e4-5726-4661-8bd3-88e878abc8cb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0880849
Jun 01 18:51:09.941978 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-de2b58af-b6f3-4c42-8844-c668ac320933 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:09.943586 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-de2b58af-b6f3-4c42-8844-c668ac320933 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.2451603
Jun 01 18:51:09.954411 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Made reservation on behalf of 398dbb1703f94d9c8306c0874e37445f for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:51:09.957076 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2101686'] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.049154 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.056495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:10.056736 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-9d1df7af-ac67-4458-966d-67af2b3062a7 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 1001 time: 0.1048498
Jun 01 18:51:10.102147 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.104696 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e5e3f92a-adf7-40b8-b630-052c45a2db57,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:10.110773 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:10.114582 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/e5e3f92a-adf7-40b8-b630-052c45a2db57 HTTP/1.1" status: 204  len: 168 time: 0.8138893
Jun 01 18:51:10.117088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37354) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:10.133102 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-dc8fb32b-146e-4e81-9465-e14417754597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:10.135174 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-dc8fb32b-146e-4e81-9465-e14417754597 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.0703657
Jun 01 18:51:10.163489 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device f99b340a-953f-45e8-bbd2-57e0b5aa8a2b no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:51:10.198975 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: f99b340a-953f-45e8-bbd2-57e0b5aa8a2b {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:51:10.199587 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device f99b340a-953f-45e8-bbd2-57e0b5aa8a2b not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:51:10.200035 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 969881a4-e1be-405f-8d2a-24f457975526 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:51:10.215360 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-7d8ed29c-3fb6-49ed-88ed-70b5c0dabf84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:10.216935 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-7d8ed29c-3fb6-49ed-88ed-70b5c0dabf84 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0737290
Jun 01 18:51:10.234167 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 969881a4-e1be-405f-8d2a-24f457975526 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:51:10.234519 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 969881a4-e1be-405f-8d2a-24f457975526 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:51:10.267022 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.350137 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-6ee87ded-e916-468e-9137-99934e41d231 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1260395
Jun 01 18:51:10.441556 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.458311 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cc62cc10>,) {'filters': {'network_id': ['7c0d1d41-a033-4bad-b3c8-a15d3b31242e']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:10.472304 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc62cc10>, '69b1d8dc-90f3-4b2d-912f-ef992caee9a2') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:10.472622 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc62cc10>, '69b1d8dc-90f3-4b2d-912f-ef992caee9a2') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:10.482064 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca6c276d-6b08-48ac-9a2b-2b81c7e81af3 req-d038fb17-c6ad-4570-a4cd-3e29740de7ec service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252310
Jun 01 18:51:10.493828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.512431 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.652135 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Releasing vlan 59 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:51:10.652452 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:51:10.668187 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:51:10.757182 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.765645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-392059b8-2c71-47b3-a3e8-fb34dae2a224 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:10.786146 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.790146 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Pushing event deleted for resources: {'Network': ['ID=7c0d1d41-a033-4bad-b3c8-a15d3b31242e,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:10.795155 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:10.807264 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] 10.222.0.22 "DELETE /v2.0/networks/7c0d1d41-a033-4bad-b3c8-a15d3b31242e HTTP/1.1" status: 204  len: 168 time: 0.6890531
Jun 01 18:51:10.858568 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1394273', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2101636'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:10.863828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6b5ba1e6-6d60-4c44-8283-e8f41d421f2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:10.920741 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37358) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:10.937238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3a47ecf9-1415-4f7e-9e5a-adde92b99974,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:10.940684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:10.946260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Checking segment: {'id': 'cf13411a-f981-4c3d-a5a3-073f8015751c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 56, 'network_id': '32a53b6b-2c02-410d-8524-e867e07e1dd4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:51:10.946615 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Network hostable DHCP agents. Network: 32a53b6b-2c02-410d-8524-e867e07e1dd4, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:51:10.964191 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Network 32a53b6b-2c02-410d-8524-e867e07e1dd4 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:51:10.975308 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-74979157-c437-4062-9b99-48e07402827b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=25a97ba1c3dd49d0bba7b78bbfa71df1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0531745
Jun 01 18:51:10.977641 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37362) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:10.978648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 32a53b6b-2c02-410d-8524-e867e07e1dd4) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:51:10.988686 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:10.989245 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f14ac11d-21fc-4895-b57e-d7139cf5f1e5 None None] Network 32a53b6b-2c02-410d-8524-e867e07e1dd4 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:51:10.989467 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.009001 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.1568599
Jun 01 18:51:11.042477 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.074716 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.189692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a87e80c-dedf-4595-af38-e3b487b2b2ea req-9aa35ba9-5dd7-449b-94f8-96bbfe5d620e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:11.191066 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6a87e80c-dedf-4595-af38-e3b487b2b2ea req-9aa35ba9-5dd7-449b-94f8-96bbfe5d620e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.1089394
Jun 01 18:51:11.212318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d476402f-9de6-4567-9d37-e3b50b549ea5 None None] Network 32a53b6b-2c02-410d-8524-e867e07e1dd4 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:51:11.217325 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.224485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6fdd918-81e8-47e2-bf1a-0b549f95d51a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:11.249220 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=618cf6a3-a6b7-49d0-8c21-a5580355cfee,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:11.253088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:11.262872 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6a87e80c-dedf-4595-af38-e3b487b2b2ea req-320f582d-b6c3-4361-b4e6-9ba447cbc3f5 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0643024
Jun 01 18:51:11.264876 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.266425 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/618cf6a3-a6b7-49d0-8c21-a5580355cfee HTTP/1.1" status: 204  len: 168 time: 0.2870665
Jun 01 18:51:11.698356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37390) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:11.703323 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1476939492-network', 'tenant_id': 'e41ce215b2c346259582c701861d4304'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:11.718176 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:11.722593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Usage tracker for resource:network and tenant:e41ce215b2c346259582c701861d4304 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:11.725639 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:11.731447 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:11.745298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Made reservation on behalf of e41ce215b2c346259582c701861d4304 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:51:11.745298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.757835 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.779198 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:11.785153 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Usage tracker for resource:security_group_rule and tenant:e41ce215b2c346259582c701861d4304 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:11.789143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:11.797274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:11.881037 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.885372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.889300 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f5ae329b-bcba-4c97-adda-a8328c388dd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:11.916018 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] vlan segment allocate from pool success with {'vlan_id': 50, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:51:11.927514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2212fe40-30f7-4314-99f9-da2f843ad189,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:11.931061 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:11.933738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.934075 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Added segment 6199bdfb-96f0-4111-a8c7-c40460fe7202 of type vlan for network 1de03f9b-1950-4b20-89a9-9b802f1e1673
Jun 01 18:51:11.960271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.995649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:11.997127 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:11.997701 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:12.001776 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-18b1ad3a-bf47-4eb8-ac89-613d9b2dabf5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:12.096962 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Pushing event updated for resources: {'Network': ['ID=1de03f9b-1950-4b20-89a9-9b802f1e1673,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:12.102416 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.4004879
Jun 01 18:51:12.102416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:12.102837 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37400) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:12.107619 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Request body: {'subnet': {'network_id': '1de03f9b-1950-4b20-89a9-9b802f1e1673', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1476939492-subnet', 'tenant_id': 'e41ce215b2c346259582c701861d4304', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:12.108470 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 1de03f9b-1950-4b20-89a9-9b802f1e1673 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:51:12.112869 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:12.116733 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Usage tracker for resource:subnet and tenant:e41ce215b2c346259582c701861d4304 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:12.119671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:12.126022 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:12.136685 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Made reservation on behalf of e41ce215b2c346259582c701861d4304 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:51:12.139002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3724192'] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:12.473182 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe560be-f612-497a-ab97-86bfd19d3a30 req-9f8c0784-da63-46cc-863a-400d448ddfb9 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:12.474678 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0fe560be-f612-497a-ab97-86bfd19d3a30 req-9f8c0784-da63-46cc-863a-400d448ddfb9 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0900109
Jun 01 18:51:12.524897 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0fe560be-f612-497a-ab97-86bfd19d3a30 req-fb7e60f2-a9a9-4bf0-8ec0-42d05dd4e625 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0422549
Jun 01 18:51:12.618129 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2209766', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3724178'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:12.622713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-45a1fae5-d97c-4d74-b36f-73db0b7713c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:12.696284 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2584d82e-792f-43ac-9fea-5159232372a6,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:12.700012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:12.707040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Checking segment: {'id': '6199bdfb-96f0-4111-a8c7-c40460fe7202', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 50, 'network_id': '1de03f9b-1950-4b20-89a9-9b802f1e1673'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:51:12.707422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Network hostable DHCP agents. Network: 1de03f9b-1950-4b20-89a9-9b802f1e1673, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:51:12.725744 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Network 1de03f9b-1950-4b20-89a9-9b802f1e1673 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:51:12.736500 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 1de03f9b-1950-4b20-89a9-9b802f1e1673) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:51:12.745581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:12.746240 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:12.754469 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c263a63-b9c9-4dfa-9505-b23010555247 None None] Network 1de03f9b-1950-4b20-89a9-9b802f1e1673 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:51:12.768688 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.6647601
Jun 01 18:51:12.974774 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-638c4a1f-8678-48eb-9f97-4abae66f2140 None None] Network 1de03f9b-1950-4b20-89a9-9b802f1e1673 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:51:13.248007 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37438) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:13.373971 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.389503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:13.393356 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Usage tracker for resource:security_group_rule and tenant:0ce14d93e34448ec94650337b9034062 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:13.396147 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:13.402128 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:13.495092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.499348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.506493 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:13.548477 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=0ce14d93e34448ec94650337b9034062&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2992923
Jun 01 18:51:13.549331 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=220b4f40-8d15-4dff-8fe1-b43414748caa,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:13.551044 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37446) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:13.552671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:13.614276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.639369 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.692926 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.697643 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d891aa02-0f7c-499b-8f57-f82ce55bd37e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:13.710658 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=220b4f40-8d15-4dff-8fe1-b43414748caa,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:13.713210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:13.714573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:13.718472 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/220b4f40-8d15-4dff-8fe1-b43414748caa HTTP/1.1" status: 204  len: 168 time: 0.1663556
Jun 01 18:51:13.721924 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22595d3-76f3-40b2-8d72-c9649118604b req-469b73f9-01d3-419b-806f-39c34ca62fa3 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:13.723412 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f22595d3-76f3-40b2-8d72-c9649118604b req-469b73f9-01d3-419b-806f-39c34ca62fa3 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0857306
Jun 01 18:51:13.772477 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f22595d3-76f3-40b2-8d72-c9649118604b req-1a8217f5-c039-43b0-938a-f3d100ac25b3 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0433888
Jun 01 18:51:13.998338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37454) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:14.015389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.029857 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:14.033796 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Usage tracker for resource:security_group_rule and tenant:42783c049b9f40e1ba13948b3637b1ac is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:14.036527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:14.042123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:14.120060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.123998 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.129114 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-a59ff484-22df-4e03-8ee6-d57f0610dbcc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.132842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cb4c0b57-a052-4019-be47-f1f2985b81fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:14.175959 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=42783c049b9f40e1ba13948b3637b1ac&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1765850
Jun 01 18:51:14.176940 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4418bbd2-79d7-4f14-9c45-213bd8e77749,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:14.178762 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37456) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:14.179886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:14.235157 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.259955 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.310325 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.315442 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-14172646-fac2-4c52-ae5e-23a024d72e71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:14.326462 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4418bbd2-79d7-4f14-9c45-213bd8e77749,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:14.330117 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:14.336396 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:14.337533 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/4418bbd2-79d7-4f14-9c45-213bd8e77749 HTTP/1.1" status: 204  len: 168 time: 0.1577902
Jun 01 18:51:14.970369 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f46acb7-230a-4f93-9f7f-2a9021b70fca req-31e6b3f6-f9f7-4429-a0eb-105b1f605b71 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:14.971944 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f46acb7-230a-4f93-9f7f-2a9021b70fca req-31e6b3f6-f9f7-4429-a0eb-105b1f605b71 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0868561
Jun 01 18:51:15.024974 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f46acb7-230a-4f93-9f7f-2a9021b70fca req-d90965d3-95be-4957-b500-7753aeb6be62 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0425093
Jun 01 18:51:15.924543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37512) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:16.040301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.054941 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:16.058604 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Usage tracker for resource:security_group_rule and tenant:13a6b78ad4ac4a11a09c3c72e4e2c80e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:16.061456 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:16.067808 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:16.190148 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.204514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.213648 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-00621ad4-6023-4bbf-b712-f0ba1be7b097 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:16.261630 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=13a6b78ad4ac4a11a09c3c72e4e2c80e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3360407
Jun 01 18:51:16.264243 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37518) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:16.265406 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a1b3a40-0112-4b7b-a0e7-bdb5ec8b268b,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:16.270884 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:16.279379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6542cfe5-0f3f-4f99-b4c8-3cabba5d0b13 req-2cc46fac-19ec-4ca0-a111-d50758b30613 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:16.280837 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6542cfe5-0f3f-4f99-b4c8-3cabba5d0b13 req-2cc46fac-19ec-4ca0-a111-d50758b30613 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.1436765
Jun 01 18:51:16.325998 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.330253 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6542cfe5-0f3f-4f99-b4c8-3cabba5d0b13 req-0a765595-0f2d-471c-a689-6bebdb42b937 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0416732
Jun 01 18:51:16.360766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.416044 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.419671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-48bb125c-7022-4aac-bc80-82b9ce03b2f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:16.433427 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a1b3a40-0112-4b7b-a0e7-bdb5ec8b268b,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:16.444683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.444986 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.445348 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.445705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.446058 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.446408 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.446754 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.447111 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.447458 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.447800 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.448144 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.448503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:16.453435 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:16.455213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.456316 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/4a1b3a40-0112-4b7b-a0e7-bdb5ec8b268b HTTP/1.1" status: 204  len: 168 time: 0.1910005
Jun 01 18:51:16.709927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-a4171c29-8bfd-4314-b888-a24c962efc22 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.757916 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37532) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:16.775716 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.790662 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:16.794517 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Usage tracker for resource:security_group_rule and tenant:a21c072b97694211abe91c22daf82473 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:16.797349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:16.803052 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:16.853292 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.887340 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.891639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:16.900223 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-22d49803-7e82-4dc9-9959-4b524bd6791e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:16.939048 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=a21c072b97694211abe91c22daf82473&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1801155
Jun 01 18:51:16.939909 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5aebe2e0-5034-4795-a0f9-91377bbf6425,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:16.941941 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37534) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:16.942869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:16.998714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:17.024752 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:17.073861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:17.077406 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a1e24015-4e8f-450d-b3d2-25919d550cf9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:17.090269 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5aebe2e0-5034-4795-a0f9-91377bbf6425,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:17.099943 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.100311 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.100693 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.101047 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.101395 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.101740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.102083 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.102425 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.102765 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.103106 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.103444 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.103780 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:51:17.108306 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:17.110264 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:17.113624 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/5aebe2e0-5034-4795-a0f9-91377bbf6425 HTTP/1.1" status: 204  len: 168 time: 0.1684070
Jun 01 18:51:17.523914 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13b045c9-082f-45a2-933b-741426701bb3 req-8471d5db-c60d-4d2c-b3f6-a631d6762d5e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:17.525427 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-13b045c9-082f-45a2-933b-741426701bb3 req-8471d5db-c60d-4d2c-b3f6-a631d6762d5e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0876932
Jun 01 18:51:17.572078 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-13b045c9-082f-45a2-933b-741426701bb3 req-8f8aa161-1f59-4915-8a61-608f65bde7a4 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0407338
Jun 01 18:51:17.805572 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:18.226056 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:51:18.759011 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f0cb4c-d7de-413f-b78e-f09baefd3aed req-f081dc48-f12c-4479-969f-5392c9d42fdc tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:18.760586 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-05f0cb4c-d7de-413f-b78e-f09baefd3aed req-f081dc48-f12c-4479-969f-5392c9d42fdc tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0835257
Jun 01 18:51:18.808167 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-05f0cb4c-d7de-413f-b78e-f09baefd3aed req-3d9bf8f0-b576-455d-931c-303855029502 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0417736
Jun 01 18:51:19.502752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:19.742895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37624) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:19.858626 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:19.873425 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:19.877291 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Usage tracker for resource:security_group_rule and tenant:1eaf1d4ed5ed49b2a4a65279b7a881c0 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:19.880121 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:19.885910 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:19.967967 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:19.972338 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:19.980986 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-475c9ebf-3db6-4132-ad13-a0c28acc9426 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:20.000277 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1255f8-1aaf-4ddd-bdbc-be50c926397d req-b5a451d3-1d18-4b31-9271-31e12ee24b9b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:20.001447 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2b1255f8-1aaf-4ddd-bdbc-be50c926397d req-b5a451d3-1d18-4b31-9271-31e12ee24b9b tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0835123
Jun 01 18:51:20.024946 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=1eaf1d4ed5ed49b2a4a65279b7a881c0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2809417
Jun 01 18:51:20.025936 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=487ae17e-97ec-4627-80f3-37d96bda44f9,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:20.027488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37630) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:20.028944 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7f305fc5-d162-426b-83f0-c99a5a3dcd70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:20.079426 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2b1255f8-1aaf-4ddd-bdbc-be50c926397d req-e9846d26-ff49-428b-aa37-85e92d6dbcaf tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0715134
Jun 01 18:51:20.110645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.135165 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.188493 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.193830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ea296c0f-a4d5-4bd3-945a-4098e7c59b5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:20.206637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=487ae17e-97ec-4627-80f3-37d96bda44f9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:20.208953 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:20.216533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.217631 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/487ae17e-97ec-4627-80f3-37d96bda44f9 HTTP/1.1" status: 204  len: 168 time: 0.1885781
Jun 01 18:51:20.487072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37638) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:20.504638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.518881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:20.522554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Usage tracker for resource:security_group_rule and tenant:b979d08b21584e94a381717398bc9886 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:20.525552 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:20.531114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:20.618707 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.622326 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.631224 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e972a7c6-41b2-4d64-ba65-95058a3ce045 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:20.671749 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=b979d08b21584e94a381717398bc9886&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1835368
Jun 01 18:51:20.673896 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d3ab30c-d097-4f00-8844-06d8485eecda,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:20.674885 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37640) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:20.676927 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:20.731677 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.757536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.814333 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.818088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4239acc5-aa2f-4883-ba80-66e940ba1fe0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:20.829977 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d3ab30c-d097-4f00-8844-06d8485eecda,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:20.832731 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:20.839636 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:20.840757 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/9d3ab30c-d097-4f00-8844-06d8485eecda HTTP/1.1" status: 204  len: 168 time: 0.1648426
Jun 01 18:51:21.290426 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee9c7e4-2716-4b53-9388-5cd8af4f58cf req-8724f6ba-b063-45a7-bf6b-667610587484 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:21.291871 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bee9c7e4-2716-4b53-9388-5cd8af4f58cf req-8724f6ba-b063-45a7-bf6b-667610587484 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0920210
Jun 01 18:51:21.338522 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bee9c7e4-2716-4b53-9388-5cd8af4f58cf req-61eb0b0c-ee76-48e5-8c66-5cb94772e0ee tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0406604
Jun 01 18:51:22.535764 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700cbaba-3ee1-4047-9598-20d73efe6a43 req-19ce630e-a0a4-440a-b247-a81bb7637c7d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:22.537304 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-700cbaba-3ee1-4047-9598-20d73efe6a43 req-19ce630e-a0a4-440a-b247-a81bb7637c7d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.0863397
Jun 01 18:51:22.596135 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-700cbaba-3ee1-4047-9598-20d73efe6a43 req-7058dd0b-07b1-4db3-890d-04d1b5efe042 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=65806fab-dac4-417e-928f-3c5c209394ed&id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0504723
Jun 01 18:51:31.352301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37810) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:31.412416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Deleting subnet 3a47ecf9-1415-4f7e-9e5a-adde92b99974 {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:51:31.415507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.468598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.523186 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.700344 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37818) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:31.827487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.846959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:31.851423 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Usage tracker for resource:security_group_rule and tenant:6729e4f92fe141fcb8b1b6c950ea1299 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:31.854544 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:31.860303 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:31.870996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.877649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-88487a87-96ec-4ede-b93c-a99c1cdff710 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:31.914740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3a47ecf9-1415-4f7e-9e5a-adde92b99974,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:31.918430 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:31.919789 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.927349 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] 10.222.0.22 "DELETE /v2.0/subnets/3a47ecf9-1415-4f7e-9e5a-adde92b99974 HTTP/1.1" status: 204  len: 168 time: 0.5739312
Jun 01 18:51:31.931938 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37826) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:31.969864 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.974924 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:31.984185 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2bc3c42e-c599-4e24-9594-16030d39b58e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:32.027817 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=6729e4f92fe141fcb8b1b6c950ea1299&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3238590
Jun 01 18:51:32.028015 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37830) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:32.038564 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f998aa7-67df-4fa5-9a06-2f19e0d3230a,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:32.039575 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.043036 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:32.096611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.123609 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.176018 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.181238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.187189 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f1c33b48-e3c0-4201-969f-f05a8bd649ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:32.189698 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd278c70>,) {'filters': {'network_id': ['32a53b6b-2c02-410d-8524-e867e07e1dd4']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:32.202398 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd278c70>, 'cf13411a-f981-4c3d-a5a3-073f8015751c') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:32.203114 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd278c70>, 'cf13411a-f981-4c3d-a5a3-073f8015751c') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:32.207400 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f998aa7-67df-4fa5-9a06-2f19e0d3230a,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:32.214413 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:32.216311 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.218577 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.222046 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/9f998aa7-67df-4fa5-9a06-2f19e0d3230a HTTP/1.1" status: 204  len: 168 time: 0.1907241
Jun 01 18:51:32.238226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.245129 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Releasing vlan 56 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:51:32.245738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:51:32.263500 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:51:32.352195 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.360872 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:32.378883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.385967 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Pushing event deleted for resources: {'Network': ['ID=32a53b6b-2c02-410d-8524-e867e07e1dd4,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:32.390679 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] 10.222.0.22 "DELETE /v2.0/networks/32a53b6b-2c02-410d-8524-e867e07e1dd4 HTTP/1.1" status: 204  len: 168 time: 0.4591649
Jun 01 18:51:32.392015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:32.392730 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37840) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:32.454143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Deleting subnet 2584d82e-792f-43ac-9fea-5159232372a6 {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:51:32.457247 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.510358 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.541746 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37842) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:32.559042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.565759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.572895 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:32.576903 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Usage tracker for resource:security_group_rule and tenant:3bd145893a3643a7bd1d84077cb45024 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:32.580188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:32.585813 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:32.678051 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.681997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.691018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0d31d7d0-b1c2-4205-ac7f-47db3c11c784 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:32.735783 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=3bd145893a3643a7bd1d84077cb45024&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1928787
Jun 01 18:51:32.736733 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28557982-29e4-48e4-94ce-754f7783391e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:32.738383 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37844) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:32.739637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:32.862260 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.897192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.904615 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.914571 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:32.960821 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2584d82e-792f-43ac-9fea-5159232372a6,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:32.963583 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:32.966194 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:32.983035 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/2584d82e-792f-43ac-9fea-5159232372a6 HTTP/1.1" status: 204  len: 168 time: 0.5891767
Jun 01 18:51:32.985593 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37846) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:33.003885 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.008700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-682ea9ec-858d-47bf-85a9-7ed4f7451594 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:33.019539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28557982-29e4-48e4-94ce-754f7783391e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:33.025406 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:33.026859 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.029769 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/28557982-29e4-48e4-94ce-754f7783391e HTTP/1.1" status: 204  len: 168 time: 0.2881365
Jun 01 18:51:33.182122 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.321365 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.333947 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cda16580>,) {'filters': {'network_id': ['1de03f9b-1950-4b20-89a9-9b802f1e1673']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:33.346558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cda16580>, '6199bdfb-96f0-4111-a8c7-c40460fe7202') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:33.346859 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cda16580>, '6199bdfb-96f0-4111-a8c7-c40460fe7202') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:33.358414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.378301 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.385593 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Releasing vlan 50 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:51:33.386092 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:51:33.402297 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:51:33.491896 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.495852 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e2d64385-3337-4a5f-b169-b6291da13a51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:33.513415 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.520791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=1de03f9b-1950-4b20-89a9-9b802f1e1673,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:33.525634 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:33.533509 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7dd0ab91-2712-461b-a6c5-63b4b03668e1 admin admin] 10.222.0.22 "DELETE /v2.0/networks/1de03f9b-1950-4b20-89a9-9b802f1e1673 HTTP/1.1" status: 204  len: 168 time: 0.5468245
Jun 01 18:51:33.659845 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37866) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:33.725534 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b86f013a-f368-4ec2-80e7-e5a1f2c777fe admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=398dbb1703f94d9c8306c0874e37445f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0623951
Jun 01 18:51:33.725746 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37872) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:33.792388 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.819211 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.860840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f99b6646-906f-43c6-b398-1e643bbd9eb4 req-040bb0e2-fc18-4a3b-912b-fbe047cd3af6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:33.862345 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f99b6646-906f-43c6-b398-1e643bbd9eb4 req-040bb0e2-fc18-4a3b-912b-fbe047cd3af6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.0934854
Jun 01 18:51:33.876799 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.880465 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a0e5f1b0-4496-4e0d-ae16-e9143cf4030a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:33.898343 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80979052-1a11-4a0f-994d-206ebc515811,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:33.906962 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:33.908312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:33.912042 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/80979052-1a11-4a0f-994d-206ebc515811 HTTP/1.1" status: 204  len: 168 time: 0.1854424
Jun 01 18:51:33.923122 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f99b6646-906f-43c6-b398-1e643bbd9eb4 req-893f3e86-77e3-4470-8801-2c1867f591bd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0548913
Jun 01 18:51:34.268021 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37892) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:34.319573 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3ff08a04-4557-49c1-8e82-6529b94d39c2 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=e41ce215b2c346259582c701861d4304&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0516756
Jun 01 18:51:34.322415 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37896) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:34.378777 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:34.404011 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:34.455818 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:34.460920 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3ef95814-4086-4b04-a087-fd8f5a8cf7cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:34.473134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2212fe40-30f7-4314-99f9-da2f843ad189,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:34.475348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:34.478750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:34.480560 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/2212fe40-30f7-4314-99f9-da2f843ad189 HTTP/1.1" status: 204  len: 168 time: 0.1570628
Jun 01 18:51:35.127418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d56f00a7-0431-445d-a6e3-591e865f7a7b req-c071a929-12db-415b-ac45-57d031456f1b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:35.129034 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d56f00a7-0431-445d-a6e3-591e865f7a7b req-c071a929-12db-415b-ac45-57d031456f1b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.0957284
Jun 01 18:51:35.180338 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d56f00a7-0431-445d-a6e3-591e865f7a7b req-5020090b-829d-4743-9a51-43ca168c4ea4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453656
Jun 01 18:51:35.515975 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-5b3c748f-8662-4954-88c0-b1210be3c11c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:35.517516 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-5b3c748f-8662-4954-88c0-b1210be3c11c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 946 time: 0.0893781
Jun 01 18:51:35.638287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37966) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:35.664833 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Deleting port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:35.665266 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:35.668819 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37970) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:35.796189 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:35.827715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:35.830635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:35.843560 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Usage tracker for resource:security_group_rule and tenant:00bd671037364fc88c8349b67aeac820 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:35.847769 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:35.853767 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:35.855997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:35.860187 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Usage tracker for resource:security_group_rule and tenant:4e881af7c6894e75ba13228bc4b46aa7 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:35.864480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:35.874297 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:35.893228 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] For port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:51:35.893590 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.008383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.020303 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.030984 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4cdf2018-344d-41e2-a26b-ae8b351add61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:36.038362 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.047375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.091086 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=00bd671037364fc88c8349b67aeac820&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4211943
Jun 01 18:51:36.095188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a75a39b3-b617-48e8-ad30-5eb28424a6e1,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:36.097112 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 37974) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:36.099084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:36.108880 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ab3e8229-6cee-4a5d-9f1c-5f0403c732c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:36.128901 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=4e881af7c6894e75ba13228bc4b46aa7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4890640
Jun 01 18:51:36.137594 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 37976) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:36.160963 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=491ec315-e91f-4c61-980f-33b52e3b0d36,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:36.169786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:36.187950 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.213505 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.214368 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.214368 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Floating IP 574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd disassociated. External IP: 172.27.0.90, port: 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2.
Jun 01 18:51:36.214580 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Calling delete_port for 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:36.217848 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.282099 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.286409 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f48b6384-739b-4af4-bf3b-45dea549dc5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:36.329694 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a75a39b3-b617-48e8-ad30-5eb28424a6e1,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:36.330489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.331957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:36.351371 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.362839 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b00f5bb2-d70a-4f6b-8e36-4ef3a6a182da service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:36.369369 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.370486 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/a75a39b3-b617-48e8-ad30-5eb28424a6e1 HTTP/1.1" status: 204  len: 168 time: 0.2724893
Jun 01 18:51:36.397215 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98800cf1-d571-421f-89fa-97af03d3b7ca req-ee3353f8-7281-42be-aa72-5b473e69294a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:36.398859 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-98800cf1-d571-421f-89fa-97af03d3b7ca req-ee3353f8-7281-42be-aa72-5b473e69294a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=38b14296-585a-4997-a8c7-7b6e55ec3d8f HTTP/1.1" status: 200  len: 868 time: 0.1022098
Jun 01 18:51:36.419659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.426317 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'Port': ['ID=55cf6496-724a-4c5e-bbb6-b4aeb491d9b2,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:36.432514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:36.446775 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-98800cf1-d571-421f-89fa-97af03d3b7ca req-2a9bbc14-90b7-470b-9beb-b73eb3d5e11a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9e249d0-daec-40d3-8b1c-207330b726e0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417800
Jun 01 18:51:36.628398 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.634192 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-201c35a5-082f-48bd-b743-a23082bd47c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:36.654045 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=491ec315-e91f-4c61-980f-33b52e3b0d36,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:36.658893 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:36.669086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:51:36.739920 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.741290 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/491ec315-e91f-4c61-980f-33b52e3b0d36 HTTP/1.1" status: 204  len: 168 time: 0.6027529
Jun 01 18:51:36.865372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:51:36.877544 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:51:36.892797 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:36.893608 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbb7b50>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:36.948271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] No DVR routers for this DVR port 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:51:36.950826 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:36.955021 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab6b7f8a-40cc-4bf8-9513-c8c03b5e98cd req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "DELETE /v2.0/ports/55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 HTTP/1.1" status: 204  len: 173 time: 1.4294264
Jun 01 18:51:36.955530 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-deleted', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:51:36.957833 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1fb933c-c781-4674-82f2-106ee003ac6f" -d '{"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-deleted", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:51:37.051182 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:51:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17d721df-ea3d-4fbb-9d41-74f3c943b6f0 x-openstack-request-id: req-17d721df-ea3d-4fbb-9d41-74f3c943b6f0 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:51:37.052024 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38b14296-585a-4997-a8c7-7b6e55ec3d8f", "name": "network-vif-deleted", "tag": "55cf6496-724a-4c5e-bbb6-b4aeb491d9b2", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:51:37.052785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-17d721df-ea3d-4fbb-9d41-74f3c943b6f0 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:51:37.053321 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38b14296-585a-4997-a8c7-7b6e55ec3d8f', 'name': 'network-vif-deleted', 'tag': '55cf6496-724a-4c5e-bbb6-b4aeb491d9b2', 'status': 'completed', 'code': 200}
Jun 01 18:51:37.178742 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:37.198647 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38004) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:37.218283 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.239557 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:37.244265 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Usage tracker for resource:security_group_rule and tenant:3d2c3c4c27f44dd18d383be63d49d446 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:37.247756 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:37.256738 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:37.361527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.367342 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.405181 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-00135e36-fecf-4f54-bbb5-876c1ff1ae31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:37.448686 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=3d2c3c4c27f44dd18d383be63d49d446&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2490361
Jun 01 18:51:37.449871 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6be96130-f63d-47a3-b16d-3c5ba6953bde,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:37.451253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38008) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:37.453902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:37.538828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.575762 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.606113 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38022) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:37.611480 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:51:37.657839 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:51:37.658592 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 55cf6496-724a-4c5e-bbb6-b4aeb491d9b2 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:51:37.664728 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.670927 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-dba5fd91-d1f1-42c8-8354-5f99903912fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:37.687026 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6be96130-f63d-47a3-b16d-3c5ba6953bde,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:37.690567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:37.697002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.701051 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6be96130-f63d-47a3-b16d-3c5ba6953bde HTTP/1.1" status: 204  len: 168 time: 0.2486274
Jun 01 18:51:37.715685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbb7b50>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:37.720376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:51:37.725763 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.729980 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:37.730605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbb7b50>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:37.757764 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.825215 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.837561 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-10225730-5a45-4afe-8a17-64cba0844a12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:37.855138 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9e249d0-daec-40d3-8b1c-207330b726e0,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:37.866618 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:37.877816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:37.882066 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38048) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:37.885834 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "DELETE /v2.0/security-groups/d9e249d0-daec-40d3-8b1c-207330b726e0 HTTP/1.1" status: 204  len: 168 time: 0.2718446
Jun 01 18:51:37.916985 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.api.v2.resource [None req-31d3c940-021c-4c16-9892-7b79d345d21c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] show failed (client error): The resource could not be found.
Jun 01 18:51:37.918518 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-31d3c940-021c-4c16-9892-7b79d345d21c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups/d9e249d0-daec-40d3-8b1c-207330b726e0 HTTP/1.1" status: 404  len: 347 time: 0.0346978
Jun 01 18:51:37.921487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38054) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:38.008813 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:38.228455 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Deleting port 32183154-9af5-4f26-b54c-60841a14967f {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:38.229006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:38.398162 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:38.398639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:38.438186 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbb7b50>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:38.442918 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbaf4fc-8b7d-4d04-aad5-b32e8cf1cbf6 None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:51:38.627978 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Calling delete_port for 32183154-9af5-4f26-b54c-60841a14967f owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:38.831649 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b7b3b97-d979-4f59-8821-5bc4938b88a0 None None] New status for floating IP 574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:51:38.877802 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:38.885415 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:38.980419 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'Port': ['ID=32183154-9af5-4f26-b54c-60841a14967f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:38.994100 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:39.073971 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.116338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.138297 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.139843 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "DELETE /v2.0/floatingips/574fdaf6-ca74-4617-9d4b-ac47f9a1b5cd HTTP/1.1" status: 204  len: 168 time: 1.2172701
Jun 01 18:51:39.151660 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-d409cdcf-a835-4d8b-a73f-002f86562745 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1429052
Jun 01 18:51:39.259262 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-44439f00-8657-4ced-803f-e457e536354a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:39.260925 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-44439f00-8657-4ced-803f-e457e536354a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 1099 time: 0.0814030
Jun 01 18:51:39.416024 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-a8d3516e-1c68-4599-aa14-d5d3538f79e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:39.417586 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-a8d3516e-1c68-4599-aa14-d5d3538f79e1 service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.1322165
Jun 01 18:51:39.621012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38144) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:39.630534 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group': {'name': 'tempest-securitygroup--175131572', 'description': 'tempest-description--1650842343'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:39.646562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:39.654711 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-241a2f55-06a6-400e-a51b-1fd402851c1b service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 200  len: 1001 time: 0.2295165
Jun 01 18:51:39.656536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:39.661041 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:39.702457 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:39.748134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.775107 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-729d3be1-8cad-49d1-97e4-f514b73377f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:39.776559 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-729d3be1-8cad-49d1-97e4-f514b73377f9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.1078148
Jun 01 18:51:39.781684 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:39.820655 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:39.827271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:39.837809 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:39.911277 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-8263d432-27f9-4a9d-8a33-9f9b21dd7b47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:39.912872 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-8263d432-27f9-4a9d-8a33-9f9b21dd7b47 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1282556
Jun 01 18:51:39.968937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.974014 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:39.980520 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-109be787-80d7-4bb8-a4f0-65bc36af909f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:40.091736 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=470a6b94-15c0-46f0-a069-d03795944f6d,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:40.094450 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.095619 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4729862
Jun 01 18:51:40.096499 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:40.098832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38168) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:40.103503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group_rule': {'security_group_id': '470a6b94-15c0-46f0-a069-d03795944f6d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:40.114331 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-df7d97a8-aa5e-4ed9-a643-7ef08b6524a4 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1935074
Jun 01 18:51:40.118161 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:40.125745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:40.128708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:40.138972 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:40.167623 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.248317 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.253358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.261872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:40.264521 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-31e3ba4e-ff89-4228-b3be-5616b7b273a8 req-3347be5b-96ac-49fc-ae98-90d6e150d650 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1433940
Jun 01 18:51:40.283193 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=88710371-ceb5-4b86-83b9-d2343ed27e95,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:40.285863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:40.295495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.296912 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f6de03d0-2c22-4aa4-8a07-c77edae57cde tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1970139
Jun 01 18:51:40.300188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38174) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:40.305660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'security_group_rule': {'security_group_id': '470a6b94-15c0-46f0-a069-d03795944f6d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:40.313024 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:40.317101 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:security_group_rule and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:40.320722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:40.327184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:40.352208 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.423007 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.428396 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.435480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:40.457410 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2617b2f2-336a-40a4-8ee0-7efcbcaff337,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:40.460310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:40.468240 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.470061 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-9feb42ab-f229-4d3e-b879-bce348cb2e64 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1688755
Jun 01 18:51:40.473114 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38178) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:40.477512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:40.483073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:40.486925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Usage tracker for resource:floatingip and tenant:41638d3f0658425aa2f15362df9748a1 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:40.489734 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:40.495383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:40.505594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.685906 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7354b6-847e-4837-a9f8-17d04835ea83 req-e9b73047-bbd4-4a50-bf9b-539093ed307c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:40.687397 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a7354b6-847e-4837-a9f8-17d04835ea83 req-e9b73047-bbd4-4a50-bf9b-539093ed307c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.1619487
Jun 01 18:51:40.755035 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6a7354b6-847e-4837-a9f8-17d04835ea83 req-f64e1347-7de7-42a5-9421-9433522a6a33 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0615017
Jun 01 18:51:40.757430 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:40.906214 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Allocated IP 172.27.0.124 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/47fc06fd-f38d-4605-bb89-0ec730261dda) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:51:41.059147 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.088567 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.092878 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cb7792ae-68f3-40ce-a402-165148621035 tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:41.154438 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:51:41.157256 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:51:41.161055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:51:41.196778 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=47fc06fd-f38d-4605-bb89-0ec730261dda,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:41.200664 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:41.244358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.306563 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.514495 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.519399 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.524878 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:41.630811 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=47fc06fd-f38d-4605-bb89-0ec730261dda,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:41.634970 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:41.642176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.665999 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:41.667482 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.1932988
Jun 01 18:51:41.945059 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b3d8ff-a892-4eb0-b430-64a3caaf84ec req-b4db33fb-406e-43f2-aad5-e6fbc067d192 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:41.946541 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-39b3d8ff-a892-4eb0-b430-64a3caaf84ec req-b4db33fb-406e-43f2-aad5-e6fbc067d192 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0815935
Jun 01 18:51:42.000619 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-39b3d8ff-a892-4eb0-b430-64a3caaf84ec req-395b9ea4-624b-4983-ae95-211d5fc1caaf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0457816
Jun 01 18:51:42.746626 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-959a5d76-cb54-4708-b4cc-902c14aafe05 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:42.748728 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-959a5d76-cb54-4708-b4cc-902c14aafe05 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0812161
Jun 01 18:51:42.885783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Deleting port 1f190c93-827a-4047-8b5a-f63e6b4ba061 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:42.886121 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:43.019266 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] For port 1f190c93-827a-4047-8b5a-f63e6b4ba061, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1f190c93-827a-4047-8b5a-f63e6b4ba061,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:51:43.019659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:43.192643 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a70c88-8920-4d75-830e-3903dd02bbda req-18c46903-d742-4c79-a5db-00449fcb1bab tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:43.194097 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d6a70c88-8920-4d75-830e-3903dd02bbda req-18c46903-d742-4c79-a5db-00449fcb1bab tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 946 time: 0.0799654
Jun 01 18:51:43.240704 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d6a70c88-8920-4d75-830e-3903dd02bbda req-746e3ed3-034b-4fdb-866b-15c74778e052 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=b96674db-5c6a-422e-ae72-a439a68bf41a&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407686
Jun 01 18:51:43.332657 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:43.332946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:43.333259 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Floating IP 385a9467-d585-4da2-96b4-edcd5d86f8d8 disassociated. External IP: 172.27.0.22, port: 1f190c93-827a-4047-8b5a-f63e6b4ba061.
Jun 01 18:51:43.333593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Calling delete_port for 1f190c93-827a-4047-8b5a-f63e6b4ba061 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:43.445708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:43.452366 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-855a6801-5d97-43b6-8922-9c153bf9a67f tempest-ServerRescueNegativeTestJSON-989498061 tempest-ServerRescueNegativeTestJSON-989498061-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:43.500853 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'Port': ['ID=1f190c93-827a-4047-8b5a-f63e6b4ba061,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:43.505223 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:43.774598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:51:43.959104 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:51:43.968867 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:51:43.980028 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:43.980669 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce91ffa0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:44.034211 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] No DVR routers for this DVR port 1f190c93-827a-4047-8b5a-f63e6b4ba061 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:51:44.036810 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:44.039613 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'name': 'network-vif-deleted', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:51:44.042148 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b81d993-1094-4fc4-82ec-54387c5c7c2d" -d '{"events": [{"server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "name": "network-vif-deleted", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:51:44.072397 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-07e010b1-c64c-407e-8253-5b2cddad8c9a req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "DELETE /v2.0/ports/1f190c93-827a-4047-8b5a-f63e6b4ba061 HTTP/1.1" status: 204  len: 173 time: 1.3175311
Jun 01 18:51:44.126667 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:51:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-870adb86-df1c-450b-a278-5408d39da0b2 x-openstack-request-id: req-870adb86-df1c-450b-a278-5408d39da0b2 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:51:44.126979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98db101a-c4a2-4771-867e-a2b70da81a7a", "name": "network-vif-deleted", "tag": "1f190c93-827a-4047-8b5a-f63e6b4ba061", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:51:44.130797 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-870adb86-df1c-450b-a278-5408d39da0b2 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:51:44.131248 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98db101a-c4a2-4771-867e-a2b70da81a7a', 'name': 'network-vif-deleted', 'tag': '1f190c93-827a-4047-8b5a-f63e6b4ba061', 'status': 'completed', 'code': 200}
Jun 01 18:51:44.183237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9c44f36d-cdb3-446f-ad4f-48eb4a009716 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:44.195364 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:44.420181 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-56833679-4a04-4025-a5d7-726c6eabbcf3 req-4272691c-aeb5-478a-ad5e-a94e1c6b100d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=98db101a-c4a2-4771-867e-a2b70da81a7a HTTP/1.1" status: 200  len: 210 time: 0.0442946
Jun 01 18:51:44.554672 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce91ffa0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:44.558479 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:51:44.567319 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:51:44.567983 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ce91ffa0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:44.762094 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:51:45.075263 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ce91ffa0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:51:45.079005 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9064f751-beaa-4d17-ba01-21e7b926c758 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:51:45.292993 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d76bd31d-8f4f-46b5-94dd-931153463e89 None None] New status for floating IP 385a9467-d585-4da2-96b4-edcd5d86f8d8: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:51:45.549608 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38222) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:45.628526 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1f190c93-827a-4047-8b5a-f63e6b4ba061 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:51:45.665427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 1f190c93-827a-4047-8b5a-f63e6b4ba061 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:51:45.665778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1f190c93-827a-4047-8b5a-f63e6b4ba061 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:51:45.702728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:45.729414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:45.788635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:45.792358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0633b01a-7dab-4a5d-a483-8372ca93c051 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:45.807827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b96674db-5c6a-422e-ae72-a439a68bf41a,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:45.810503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:45.818187 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:45.819310 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "DELETE /v2.0/security-groups/b96674db-5c6a-422e-ae72-a439a68bf41a HTTP/1.1" status: 204  len: 168 time: 0.2687025
Jun 01 18:51:45.824468 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38224) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:45.837970 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.api.v2.resource [None req-224d3906-4e88-44bc-83d8-d3b9cc6cfe11 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] show failed (client error): The resource could not be found.
Jun 01 18:51:45.839013 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-224d3906-4e88-44bc-83d8-d3b9cc6cfe11 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups/b96674db-5c6a-422e-ae72-a439a68bf41a HTTP/1.1" status: 404  len: 347 time: 0.0161412
Jun 01 18:51:45.841801 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38226) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:46.060719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Deleting port 82098b46-2a19-46bd-be09-02a3c2d6d83e {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:51:46.060975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.177621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.177957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.303810 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Calling delete_port for 82098b46-2a19-46bd-be09-02a3c2d6d83e owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:51:46.423461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.428117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-835df3e9-e388-4569-b44a-7fdd1841cfcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:46.472401 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'Port': ['ID=82098b46-2a19-46bd-be09-02a3c2d6d83e,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:46.498229 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:46.563850 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.579119 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.580158 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d280fac0-35cc-4cfb-9a8f-f623a3b0b0e5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "DELETE /v2.0/floatingips/385a9467-d585-4da2-96b4-edcd5d86f8d8 HTTP/1.1" status: 204  len: 168 time: 0.7374694
Jun 01 18:51:46.712026 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-751adfd6-7be4-440b-8c27-45ec3becc674 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.854739 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.867657 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38234) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:46.872302 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1099834045', 'description': 'tempest-description--449794635'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:46.878997 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:46.882993 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:46.885875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:46.892792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:46.902639 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:46.924532 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:46.928377 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:46.931329 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:46.937753 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:47.007515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.011274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.016339 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7dce28eb-87cd-484b-88d6-afb7df013dcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:47.057297 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroup': ['ID=398f1790-52b8-4b43-bf30-e5cebc034385,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:47.060199 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.061445 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.1928067
Jun 01 18:51:47.062849 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:47.065354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38236) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:47.069103 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group_rule': {'security_group_id': '398f1790-52b8-4b43-bf30-e5cebc034385', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:47.075206 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:47.079227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:47.082271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:47.087896 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:47.102989 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.163042 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.166561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.168777 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:47.193266 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9639dbdc-f994-46d6-b7e0-215e4445a6a6,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:47.196061 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:47.202958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.204231 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c3d38224-3954-40fd-8d0d-9111a94d49ff tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1385396
Jun 01 18:51:47.206863 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38238) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:47.211217 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'security_group_rule': {'security_group_id': '398f1790-52b8-4b43-bf30-e5cebc034385', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:47.217456 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:47.221448 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:security_group_rule and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:47.224315 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:47.229981 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:47.247621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.308772 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.313553 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.319718 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0b8e108a-11b8-4cbf-b011-8f1d62b1599d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:47.337775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95e70724-b39d-46ad-b27c-5df009efbbe2,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:47.339843 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:47.348383 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.352318 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1417918
Jun 01 18:51:47.352752 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38242) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:51:47.357168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:47.363631 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:47.367383 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Usage tracker for resource:floatingip and tenant:e471347ca004404f94563ac66c74dc87 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:51:47.370214 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:51:47.375957 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:47.387007 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.528721 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.668749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Allocated IP 172.27.0.83 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:51:47.806612 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.820248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.850423 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:47.854840 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:47.914185 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:51:47.917013 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:51:47.919461 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:51:47.961006 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:47.963911 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:48.010271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.082488 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.289328 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.293808 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.297295 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-67f58838-f049-44bd-93d4-b2eaac8562f4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:51:48.399049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:51:48.406812 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:51:48.415316 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.437172 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:48.438450 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.0847678
Jun 01 18:51:49.504271 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:55.225363 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:51:57.277944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-4c36e3cc-a240-45a1-85dd-0aa4b3b2ec73 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:57.302710 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-4c36e3cc-a240-45a1-85dd-0aa4b3b2ec73 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:57.304038 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-4c36e3cc-a240-45a1-85dd-0aa4b3b2ec73 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-securitygroup--1099834045&fields=id&tenant_id=e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 267 time: 0.0781224
Jun 01 18:51:57.368676 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-6bd25ae4-d6d3-4e5e-a6a2-be16ea306e25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:57.384006 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-6bd25ae4-d6d3-4e5e-a6a2-be16ea306e25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:57.385249 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-6bd25ae4-d6d3-4e5e-a6a2-be16ea306e25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-securitygroup--175131572&fields=id&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 267 time: 0.1559391
Jun 01 18:51:57.465092 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-a9aeddb4-6aab-4710-9baf-834f7e55ef0d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:57.465858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-a9aeddb4-6aab-4710-9baf-834f7e55ef0d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:network {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:57.482624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-a9aeddb4-6aab-4710-9baf-834f7e55ef0d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:network {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:57.484160 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-a9aeddb4-6aab-4710-9baf-834f7e55ef0d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 810 time: 0.1725044
Jun 01 18:51:57.502011 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d253d295-3628-477a-8781-a9a52b48b8d6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/quotas/e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 375 time: 0.0105424
Jun 01 18:51:57.537051 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-28ccf2f4-7b30-48f3-9654-43058c5eb704 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:57.538635 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-28ccf2f4-7b30-48f3-9654-43058c5eb704 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 817 time: 0.1468186
Jun 01 18:51:57.553917 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c4edaee1-8364-44b2-a10c-031a7e0b7626 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/quotas/41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 375 time: 0.0095522
Jun 01 18:51:57.590071 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d1a86bb8-ab88-4b3a-9f81-8aac347da68e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:57.612108 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d1a86bb8-ab88-4b3a-9f81-8aac347da68e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:57.613525 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d1a86bb8-ab88-4b3a-9f81-8aac347da68e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1063700
Jun 01 18:51:57.646647 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-fd8b0dde-c828-4cf1-b4b9-562d3a3c9814 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:57.661721 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-fd8b0dde-c828-4cf1-b4b9-562d3a3c9814 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:57.663332 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-fd8b0dde-c828-4cf1-b4b9-562d3a3c9814 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1041701
Jun 01 18:51:57.757262 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-1aa73a37-52c7-4c87-881e-6fdfa1cfeb48 service neutron] 10.222.0.22 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1321952
Jun 01 18:51:57.806663 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-7468e052-d93e-4353-889c-cceed419aa31 service neutron] 10.222.0.22 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1307158
Jun 01 18:51:57.905012 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-e92549b3-b807-44aa-9d46-40500b79cf21 service neutron] 10.222.0.22 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419039
Jun 01 18:51:57.949229 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-a56447dc-6c90-46d1-bfbe-0e7aa60f3270 service neutron] 10.222.0.22 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1359644
Jun 01 18:51:58.097231 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4214b10e-b8c0-4eb8-88ba-ee4b8ce0064e req-91b10350-3ec3-452b-b7e3-34b4ffeef4a4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 210 time: 0.0557902
Jun 01 18:51:58.153590 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ee9145b6-ba86-4e27-8f96-f465c10c4b0b req-4a7f9513-003b-4174-9335-c35040c57266 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 210 time: 0.0598845
Jun 01 18:51:59.269349 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8002768e-b728-4dd5-aeb5-1d4fad1b8e13 req-3250b9b2-a603-4570-9f7b-421f76ad32b6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 210 time: 0.0540550
Jun 01 18:51:59.362570 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-79c2942f-27ce-4997-9a1b-a9e4315dea31 req-f9f4d714-b9b0-4c4a-9c78-92a370e2a076 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 210 time: 0.0558383
Jun 01 18:51:59.384276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d6f68e96-547d-4dd4-98bd-32586cd59818 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:59.385731 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-d6f68e96-547d-4dd4-98bd-32586cd59818 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 810 time: 0.2433200
Jun 01 18:51:59.436632 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-b3a81030-9e7b-482f-adc5-899b38fba54d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:51:59.448861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-ff373d47-1823-4328-9fca-d358be0e0958 req-b3a81030-9e7b-482f-adc5-899b38fba54d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:51:59.450097 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-b3a81030-9e7b-482f-adc5-899b38fba54d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e471347ca004404f94563ac66c74dc87 HTTP/1.1" status: 200  len: 380 time: 0.0535376
Jun 01 18:51:59.460065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'port': {'device_id': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'admin_state_up': True, 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'security_groups': ['398f1790-52b8-4b43-bf30-e5cebc034385']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:51:59.596309 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:51:59.633048 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:51:59.664029 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Made reservation on behalf of e471347ca004404f94563ac66c74dc87 for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:51:59.667504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:51:59.841975 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-31fd6303-d495-499d-a673-a6f96c2b9a25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:51:59.844316 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-31fd6303-d495-499d-a673-a6f96c2b9a25 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 817 time: 0.2383928
Jun 01 18:51:59.951440 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-d05f8ce2-ea18-4d01-89bf-7c12460837e5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 379 time: 0.0684590
Jun 01 18:51:59.952459 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Allocated IP 172.20.0.11 (87c3456d-8d78-42d4-81e0-1f541c3dcc2f/108da5f2-bebc-4996-9e93-e596166088ad/2fb95b17-86cc-49d3-8ae6-61048a81d7e9) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:51:59.964524 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'port': {'device_id': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'admin_state_up': True, 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'security_groups': ['470a6b94-15c0-46f0-a069-d03795944f6d']}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:00.203002 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:00.228516 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:00.260012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Made reservation on behalf of 41638d3f0658425aa2f15362df9748a1 for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:52:00.263510 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:00.371422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:00.419784 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bc737699-a5a1-43d8-bf7b-267c934e325d req-6c28d2f9-3867-4ad6-96e2-ef48a7f26b1e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 210 time: 0.0426576
Jun 01 18:52:00.434823 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Transition to ACTIVE for port object 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:00.554702 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8b19e1aa-46ed-480e-947c-7f028ced1b8e req-5777b12a-4aca-44f0-8eb6-1b3f37c2fadc tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 210 time: 0.0511866
Jun 01 18:52:00.580600 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:00.588056 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-766e74ce-63dd-490f-8e15-ca3c14e8a20e tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:00.626184 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Allocated IP 172.20.0.8 (d5efada3-47d7-493b-989f-ef9ac42a4054/3bc46f81-88af-4aba-902a-90b4633edf6a/1151ad48-db08-470c-a31f-319eab029862) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:00.667795 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:00.672988 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:00.678517 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:00.721919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event updated for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:00.728872 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:00.786902 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:00.787516 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:00.854354 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ab12cb34-3db8-422f-a97e-b673548f1a0b None None] Provisioning for port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:00.859313 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ab12cb34-3db8-422f-a97e-b673548f1a0b None None] Provisioning complete for port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:00.860356 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ab12cb34-3db8-422f-a97e-b673548f1a0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:00.896061 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.4395838
Jun 01 18:52:00.909559 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Request body: {'port': {'device_id': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:00.917112 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ab12cb34-3db8-422f-a97e-b673548f1a0b None None] Port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:00.990203 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.051562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Transition to ACTIVE for port object 1151ad48-db08-470c-a31f-319eab029862 will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:01.063127 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.189372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.198141 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9a9be813-46b6-4655-8a3b-a6be35c524bf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:01.333149 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Network d5efada3-47d7-493b-989f-ef9ac42a4054 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:01.339215 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:01.360170 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:01.386525 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:01.399966 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:01.498032 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:01.498639 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.522353 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b0f663-db19-4b16-b1a6-b7cf9c5cc153 req-78eb8bdf-6a8b-49a6-a65a-5eb53a5838b2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:01.524069 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-86b0f663-db19-4b16-b1a6-b7cf9c5cc153 req-78eb8bdf-6a8b-49a6-a65a-5eb53a5838b2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.3867488
Jun 01 18:52:01.545269 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b385173a-9aaf-43f4-b3c1-f48c8cb961ab None None] Provisioning for port 1151ad48-db08-470c-a31f-319eab029862 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:01.551066 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-b385173a-9aaf-43f4-b3c1-f48c8cb961ab None None] Provisioning complete for port 1151ad48-db08-470c-a31f-319eab029862 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:01.551452 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b385173a-9aaf-43f4-b3c1-f48c8cb961ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.554207 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-3548945a-3835-42ce-b903-4dd530ac7157 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5961752
Jun 01 18:52:01.569880 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Request body: {'port': {'device_id': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:01.611581 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-b385173a-9aaf-43f4-b3c1-f48c8cb961ab None None] Port 1151ad48-db08-470c-a31f-319eab029862 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:01.628732 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cce2175-e85d-4880-ba21-9b54c7928817 req-bf812737-d9dc-4ffe-938e-08abf57800ef tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:01.630370 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4cce2175-e85d-4880-ba21-9b54c7928817 req-bf812737-d9dc-4ffe-938e-08abf57800ef tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 932 time: 0.1007261
Jun 01 18:52:01.665189 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-86b0f663-db19-4b16-b1a6-b7cf9c5cc153 req-8eb8e864-54fc-4d5b-8453-9661050f0964 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1277475
Jun 01 18:52:01.684275 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4cce2175-e85d-4880-ba21-9b54c7928817 req-c8986c0c-4ed1-45b2-b43f-0e0ad170f7a3 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0470362
Jun 01 18:52:01.781186 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.797813 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:52:01.808322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.907322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Transition to ACTIVE for port object 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:01.920158 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:01.926504 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-15c5d022-b276-4c96-8710-a7cc2018870a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:02.217462 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Pushing event updated for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:02.246738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:02.377993 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2aea3-786d-4da6-b21f-9d07dbb69eeb req-1ea755f0-f0fb-4302-af39-e96d9b1a7833 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:02.378603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-b4d2aea3-786d-4da6-b21f-9d07dbb69eeb req-1ea755f0-f0fb-4302-af39-e96d9b1a7833 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:02.432180 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-b4d2aea3-786d-4da6-b21f-9d07dbb69eeb req-1ea755f0-f0fb-4302-af39-e96d9b1a7833 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:02.433253 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4d2aea3-786d-4da6-b21f-9d07dbb69eeb req-1ea755f0-f0fb-4302-af39-e96d9b1a7833 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 931 time: 0.6277349
Jun 01 18:52:02.468749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Attempting to bind port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:02.469598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Attempting to bind port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:02.469925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Attempting to bind port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:02.482088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:52:02.482411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Attempting to bind port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 on network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:02.503849 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 51, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:02.504184 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Checking segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:02.504603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Bound using segment: {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:02.505022 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Bound port: 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '65814869-c1b9-439f-bc83-43e6e5c7712d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 61, 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:02.506324 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:02.518274 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b4d2aea3-786d-4da6-b21f-9d07dbb69eeb req-845da8b0-08fd-47ec-99cd-6bfe0d82d798 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0716484
Jun 01 18:52:02.633864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:52:02.651887 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:02.673883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:02.676050 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Transition to ACTIVE for port object 1151ad48-db08-470c-a31f-319eab029862 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:02.678039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:02.679480 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:02.683519 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0cc14c2c-b27c-4074-a123-8dd6a5e80d39 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:02.719806 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:02.808860 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:02.809604 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:02.811026 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] 10.222.0.25 "PUT /v2.0/ports/2fb95b17-86cc-49d3-8ae6-61048a81d7e9 HTTP/1.1" status: 200  len: 1094 time: 1.9061217
Jun 01 18:52:02.818958 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:02.819738 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f" -d '{"events": [{"name": "network-changed", "server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:02.846776 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:02.856291 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:02.862464 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-76de48ad-cbd2-427d-98e7-5dbd238fe2b8 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.126s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:02.988275 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3baf4239-e118-4105-a298-313b777d1609 req-8c87e508-df1e-40de-ba5f-07e26497326b tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:02.992923 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3baf4239-e118-4105-a298-313b777d1609 req-8c87e508-df1e-40de-ba5f-07e26497326b tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1177814
Jun 01 18:52:03.047187 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3baf4239-e118-4105-a298-313b777d1609 req-2bb3f0d9-c769-4051-991b-d34af8c74a5a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0512230
Jun 01 18:52:03.106838 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bf5749f-be9f-47bc-b423-2651a00778a7 x-openstack-request-id: req-0bf5749f-be9f-47bc-b423-2651a00778a7 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:03.107158 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:03.107436 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-0bf5749f-be9f-47bc-b423-2651a00778a7 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:03.107849 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'status': 'completed', 'code': 200}
Jun 01 18:52:03.150681 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Pushing event updated for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:03.164518 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:03.178469 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Attempting to bind port 1151ad48-db08-470c-a31f-319eab029862 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:03.178806 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Attempting to bind port 1151ad48-db08-470c-a31f-319eab029862 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:03.179135 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Attempting to bind port 1151ad48-db08-470c-a31f-319eab029862 on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:03.189359 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Port 1151ad48-db08-470c-a31f-319eab029862 on network d5efada3-47d7-493b-989f-ef9ac42a4054 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:52:03.189619 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Attempting to bind port 1151ad48-db08-470c-a31f-319eab029862 on network d5efada3-47d7-493b-989f-ef9ac42a4054 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:03.198948 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 51, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:03.199285 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Checking segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:03.199664 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Bound using segment: {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:03.200082 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Bound port: 1151ad48-db08-470c-a31f-319eab029862, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13fe2f88-2641-4a98-bd4a-51b0be7341a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 58, 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:03.200436 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:03.212933 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-e3d09ecf-0402-40d4-a95e-afdf58f56947 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.214404 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-e3d09ecf-0402-40d4-a95e-afdf58f56947 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 1097 time: 0.3162823
Jun 01 18:52:03.223996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc88af9c-31d3-40d5-80bc-6eb9ed907a11 req-1cb6642a-64d3-44d1-b76e-6edd673ef02d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.224665 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-cc88af9c-31d3-40d5-80bc-6eb9ed907a11 req-1cb6642a-64d3-44d1-b76e-6edd673ef02d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Synchronizing usage tracker for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:03.321040 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-a87718c4-3dee-43e0-9dff-0cae30f9a344 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9 HTTP/1.1" status: 200  len: 217 time: 0.0912926
Jun 01 18:52:03.394918 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-cc88af9c-31d3-40d5-80bc-6eb9ed907a11 req-1cb6642a-64d3-44d1-b76e-6edd673ef02d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Unset dirty status for tenant:e471347ca004404f94563ac66c74dc87 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:03.396028 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cc88af9c-31d3-40d5-80bc-6eb9ed907a11 req-1cb6642a-64d3-44d1-b76e-6edd673ef02d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 944 time: 0.4143245
Jun 01 18:52:03.442154 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:03.446073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-bde7ff1c-883e-4025-9e82-856332bdf9a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.447534 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-bde7ff1c-883e-4025-9e82-856332bdf9a8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.1160533
Jun 01 18:52:03.508662 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:03.512099 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-cc88af9c-31d3-40d5-80bc-6eb9ed907a11 req-b4bb0343-7c64-4310-81b1-09997f2798d0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1081204
Jun 01 18:52:03.519769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:03.525930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-21231971-dac2-4153-a265-5d8e5211a29f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:03.564164 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-b798b9ef-200c-4062-9d14-a42b533b56a8 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-259401608&fields=id&tenant_id=35f75df4cb564b1dad14fd0d02d3c46b HTTP/1.1" status: 200  len: 267 time: 0.0526786
Jun 01 18:52:03.592967 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.593571 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:03.595278 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] 10.222.0.25 "PUT /v2.0/ports/1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 1093 time: 2.0293624
Jun 01 18:52:03.616790 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:03.621312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:03.624094 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff373d47-1823-4328-9fca-d358be0e0958 req-f4505249-0c17-4cd9-b4d8-06f35cfb06ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.626211 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-f4505249-0c17-4cd9-b4d8-06f35cfb06ff service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1642852
Jun 01 18:52:03.682144 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-b9074508-b7dc-4dca-b0d2-fd385b033f31 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:03.688948 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-b9074508-b7dc-4dca-b0d2-fd385b033f31 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 984 time: 0.1181371
Jun 01 18:52:03.696001 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Request body: {'port': {'security_groups': ['9ec7d009-a5f3-4e97-b404-46080b7ac538']}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:03.923709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.016747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-a9c6ece2-3580-47ab-903c-5d0ddfd2c06c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.018200 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-a9c6ece2-3580-47ab-903c-5d0ddfd2c06c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1096 time: 0.3511147
Jun 01 18:52:04.028582 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-b212a9ac-9c37-45c6-a6b5-97485bc5c1b9 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3914750
Jun 01 18:52:04.144850 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-353f2a74-5a5a-4d43-9a3b-0e74efce75ba req-bb998427-02f2-4eb4-b070-2d84d94625fd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.146321 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-353f2a74-5a5a-4d43-9a3b-0e74efce75ba req-bb998427-02f2-4eb4-b070-2d84d94625fd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.4803214
Jun 01 18:52:04.150191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-0f0ea4fa-44eb-41e7-acfb-59dfc320cb10 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 217 time: 0.1191528
Jun 01 18:52:04.212507 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:04.241107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.246836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.259967 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:04.263387 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f6ac1b8d-6722-4895-ae10-0b29abe7f7be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:04.332118 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-353f2a74-5a5a-4d43-9a3b-0e74efce75ba req-533f1c65-da5c-4ec4-bc8e-75209922e6fe tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1791956
Jun 01 18:52:04.336222 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ff373d47-1823-4328-9fca-d358be0e0958 req-c9e67de9-bff2-47c6-992d-887148bf5db2 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2499778
Jun 01 18:52:04.350640 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-ee2e8254-03c4-4022-825a-363e952217fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.352076 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-ee2e8254-03c4-4022-825a-363e952217fc service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.1559627
Jun 01 18:52:04.355334 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.356392 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.361367 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-89d21143-9d08-4591-a6c3-de5f25cf0f09 req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "PUT /v2.0/ports/57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 942 time: 0.6702614
Jun 01 18:52:04.362049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:04.364938 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d089d17-139a-4d24-a9b0-a7555a365e11" -d '{"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:04.367999 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38422) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:04.488296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event updated for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=7']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:04.492478 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-900f88eb-9378-4c56-a3ad-1179696153ab x-openstack-request-id: req-900f88eb-9378-4c56-a3ad-1179696153ab {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:04.493070 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:04.493356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-900f88eb-9378-4c56-a3ad-1179696153ab {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:04.493784 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:52:04.504838 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:04.507013 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:04.571006 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-8d2c3057-49e3-49e6-8be4-3c27fde73feb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.572589 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-8d2c3057-49e3-49e6-8be4-3c27fde73feb service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2130854
Jun 01 18:52:04.607010 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-969d0f02-9f94-4033-83b5-71598ef5af8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.608497 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-969d0f02-9f94-4033-83b5-71598ef5af8e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 1097 time: 0.1845317
Jun 01 18:52:04.686210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.805986 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-9c69c2d0-9dfc-4df7-a088-9ff738de0473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.807833 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-9c69c2d0-9dfc-4df7-a088-9ff738de0473 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1098 time: 0.3040872
Jun 01 18:52:04.812125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.824723 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-d6e0f76b-9d15-4ccf-a5b3-b2bfa723145e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.826567 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-d6e0f76b-9d15-4ccf-a5b3-b2bfa723145e service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.2085514
Jun 01 18:52:04.900704 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-819c11a2-eb92-42c4-81b1-c4496305d250 None None] Provisioning complete for port 57350594-9e66-45d7-9d43-cd9828eb72bb triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:04.901460 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-819c11a2-eb92-42c4-81b1-c4496305d250 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:04.982681 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-47767fd7-3eaa-49d7-8c93-4c9cca68c2af service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9 HTTP/1.1" status: 200  len: 217 time: 0.0940714
Jun 01 18:52:04.993652 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6c94bd-0223-4e35-8d2a-ca144ef80328 req-77156485-e644-4f14-9e65-3bea1087adc7 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:04.995140 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5c6c94bd-0223-4e35-8d2a-ca144ef80328 req-77156485-e644-4f14-9e65-3bea1087adc7 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 944 time: 0.2755396
Jun 01 18:52:05.050732 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-dd5b338f-2e8a-45c2-80f4-82073ec118b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.052318 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-dd5b338f-2e8a-45c2-80f4-82073ec118b5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.2318821
Jun 01 18:52:05.109019 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:05.111763 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a" -d '{"events": [{"name": "network-changed", "server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:05.114559 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:05.128126 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c767696b-c0c6-4ee7-943e-ffc4a324159d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:05.158180 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-b71cd4ba-bd82-4c33-9691-072eb7c7d0aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.160169 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-b71cd4ba-bd82-4c33-9691-072eb7c7d0aa service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.1238985
Jun 01 18:52:05.161986 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-6d231519-6221-46fc-96f3-0b04082abc5b service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5775032
Jun 01 18:52:05.162655 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5c6c94bd-0223-4e35-8d2a-ca144ef80328 req-400c8ea6-bb1c-4493-9c4c-0427fa19f577 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1420591
Jun 01 18:52:05.166902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=65806fab-dac4-417e-928f-3c5c209394ed,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:05.171117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:05.202981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:05.204149 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "DELETE /v2.0/security-groups/65806fab-dac4-417e-928f-3c5c209394ed HTTP/1.1" status: 204  len: 168 time: 0.8184605
Jun 01 18:52:05.207005 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38436) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:05.245310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e324236c-0445-4725-8374-3f1c90dbac98 x-openstack-request-id: req-e324236c-0445-4725-8374-3f1c90dbac98 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:05.245720 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "tag": "1151ad48-db08-470c-a31f-319eab029862", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:05.246001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e324236c-0445-4725-8374-3f1c90dbac98 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:05.246486 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'status': 'completed', 'code': 200}
Jun 01 18:52:05.264565 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d09fdae-fc4f-4696-aeb0-ec0f2a3bfe08 req-a36736db-cf1c-4aa1-870c-9eb889509ce2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.266031 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3d09fdae-fc4f-4696-aeb0-ec0f2a3bfe08 req-a36736db-cf1c-4aa1-870c-9eb889509ce2 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.4385617
Jun 01 18:52:05.286372 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-e447c4dd-99fd-444e-98cb-393fc144b8aa service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 1001 time: 0.2262328
Jun 01 18:52:05.409737 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3d09fdae-fc4f-4696-aeb0-ec0f2a3bfe08 req-eddd2e34-e727-481c-bc6b-1c902d58d0bd tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1315427
Jun 01 18:52:05.427291 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-681db161-4d39-459a-83d6-37c8b72efe04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.428565 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-681db161-4d39-459a-83d6-37c8b72efe04 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2487299
Jun 01 18:52:05.430474 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-520cc23a-7c19-4047-8c78-8dfc8a9aa792 req-6fff572a-103f-42ef-a63b-752564d2552b service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2518041
Jun 01 18:52:05.442121 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-624bed9c-4878-41b4-b6a0-e9bc0482c8c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.443566 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-624bed9c-4878-41b4-b6a0-e9bc0482c8c8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.1499884
Jun 01 18:52:05.650713 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-2a408f13-04ca-454f-a931-6f04c0abd586 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1899216
Jun 01 18:52:05.669790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Deleting port 98a229be-fab5-47f5-82cb-67fb032f2098 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:05.670238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:05.707262 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-f3948ef3-5019-4243-bf4e-89726928bc7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.707969 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-442725d0-bcff-42b1-a9ba-f47ab48f2907 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.708204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-f3948ef3-5019-4243-bf4e-89726928bc7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:05.709465 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-442725d0-bcff-42b1-a9ba-f47ab48f2907 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1096 time: 0.1607809
Jun 01 18:52:05.715464 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-1c8a5e07-db81-4f80-a2f6-c99775eae0bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:05.717056 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-1c8a5e07-db81-4f80-a2f6-c99775eae0bd service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2647138
Jun 01 18:52:05.734782 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:52:05.909394 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:05.917664 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-f3948ef3-5019-4243-bf4e-89726928bc7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:05.924936 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-f3948ef3-5019-4243-bf4e-89726928bc7c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.4422355
Jun 01 18:52:05.928336 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'port_id': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'mac_address': 'fa:16:3e:0e:e5:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 61, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:52:05.971108 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b8a9d914-2dc4-43a1-8570-cee8a9783a1f req-ef63861f-9bbc-447b-85fb-2c912f009054 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3107972
Jun 01 18:52:06.054179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.075961 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:52:06.096614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-7bd0c98c-1483-431e-86a8-e7b404a7ceaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:06.096783 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:06.098725 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-7bd0c98c-1483-431e-86a8-e7b404a7ceaa service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.3232172
Jun 01 18:52:06.102341 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.111944 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:06.188136 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-19a050ef-cd14-4110-a0ae-e6852aa7245d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Synchronizing usage tracker for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:06.192476 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-79326575-084b-42f8-9837-7faf0746cabc service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 217 time: 0.0874996
Jun 01 18:52:06.208637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.208983 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.258933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-19a050ef-cd14-4110-a0ae-e6852aa7245d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Unset dirty status for tenant:41638d3f0658425aa2f15362df9748a1 on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:06.260099 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e18dd4ae-922b-4b33-8e24-d97e29d9fe66 req-19a050ef-cd14-4110-a0ae-e6852aa7245d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3341618
Jun 01 18:52:06.266509 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:06.278102 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.278455 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.278797 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.279159 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.279465 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.280040 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.280192 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.280417 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.280761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.281084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.281944 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.282260 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:06.287706 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:06.357429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['2fb95b17-86cc-49d3-8ae6-61048a81d7e9'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:06.358667 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-9115e753-2bee-4d77-9212-fca23b7e23f5 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6345365
Jun 01 18:52:06.374508 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-2c1d3641-9086-4b3b-ad7c-405caabb6a11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:06.376191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-2c1d3641-9086-4b3b-ad7c-405caabb6a11 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.1762598
Jun 01 18:52:06.461830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Calling delete_port for 98a229be-fab5-47f5-82cb-67fb032f2098 owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:06.489604 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38460) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:06.516120 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-a0aeed58-f1e7-4751-a8c0-66db20d9feab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:06.518042 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-a0aeed58-f1e7-4751-a8c0-66db20d9feab service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1324408
Jun 01 18:52:06.527348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d6fa72-d7b0-4ee7-bffe-32f4c4a4bc3d req-37aa00c8-7fa2-488e-a9ba-e36dfcb98642 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:06.528976 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-21d6fa72-d7b0-4ee7-bffe-32f4c4a4bc3d req-37aa00c8-7fa2-488e-a9ba-e36dfcb98642 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 945 time: 0.2156899
Jun 01 18:52:06.630224 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8d089d17-139a-4d24-a9b0-a7555a365e11 req-6675ea01-6feb-4e5d-a140-41586f7fa6fb service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2003214
Jun 01 18:52:06.673293 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-21d6fa72-d7b0-4ee7-bffe-32f4c4a4bc3d req-d283c7e4-c666-45ad-a916-07be343d6a46 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1222281
Jun 01 18:52:06.707457 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-6404c707-c288-4e95-a648-1b136a502fa0 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1775103
Jun 01 18:52:06.715881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.739290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:06.745246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Usage tracker for resource:security_group_rule and tenant:6d19dd590e5c46e9a108947d1e521c03 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:06.756289 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:06.765372 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:06.851528 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f30f65d6-b431-4a94-be54-54ecc5ab9c1a req-1eeb870d-ae69-479e-8e4d-15b581cb6fd5 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1368394
Jun 01 18:52:06.859307 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a95806-ad67-451e-b8c6-ac5c07b40f76 req-065fe19e-8e2b-4ae2-a9e4-67aaf8420712 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:06.861328 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08a95806-ad67-451e-b8c6-ac5c07b40f76 req-065fe19e-8e2b-4ae2-a9e4-67aaf8420712 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.2302463
Jun 01 18:52:06.928654 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:06.938314 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:06.986585 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-08a95806-ad67-451e-b8c6-ac5c07b40f76 req-66aac501-59d3-4d92-8212-85dd65dbe9f8 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1155422
Jun 01 18:52:06.995367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event deleted for resources: {'Port': ['ID=98a229be-fab5-47f5-82cb-67fb032f2098,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:07.028976 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:07.075162 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.079924 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.089386 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-74ae3be6-faa2-4653-8d80-2d57a568a36a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:07.137949 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=6d19dd590e5c46e9a108947d1e521c03&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6473582
Jun 01 18:52:07.141298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38466) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:07.146237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.146529 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Floating IP bd83f58c-ab91-47f9-a413-2b0d622fc6e0 disassociated (deleted). External IP: 172.27.0.140, port: 57350594-9e66-45d7-9d43-cd9828eb72bb.
Jun 01 18:52:07.197980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62f14c8f-b2d6-4f4a-a12c-8f639a5eca68,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:07.206385 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:07.209370 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.239784 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.300631 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.306385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-39d357c0-1bca-4217-a11a-670ddb007955 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:07.319116 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62f14c8f-b2d6-4f4a-a12c-8f639a5eca68,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:07.324049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:07.325766 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.327167 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-17bbffe5-2f3b-43f2-b549-9f886c3c1a64 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/62f14c8f-b2d6-4f4a-a12c-8f639a5eca68 HTTP/1.1" status: 204  len: 168 time: 0.1844430
Jun 01 18:52:07.493574 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dc98cd-aea8-4bcd-886c-3a96dd1f7371 req-c43b2506-7b8e-4c2d-a91e-da049c57734f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:07.500816 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b7dc98cd-aea8-4bcd-886c-3a96dd1f7371 req-c43b2506-7b8e-4c2d-a91e-da049c57734f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0967729
Jun 01 18:52:07.563896 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b7dc98cd-aea8-4bcd-886c-3a96dd1f7371 req-c907a0ca-37ee-4cd4-acff-7caabab3491d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0620627
Jun 01 18:52:07.567230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Router dd23659b-80fb-4c76-accf-8fae6eeb1c47 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:07.752967 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:52:07.755287 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:07.921300 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:07.928308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:07.935651 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:07.936044 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:07.967790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a50b1f2-2cd2-40f5-afd0-eac19c40db8e req-5a698609-783e-47cd-9d6f-0ae0528905d6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:07.969416 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Sync routers for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:07.970508 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2a50b1f2-2cd2-40f5-afd0-eac19c40db8e req-5a698609-783e-47cd-9d6f-0ae0528905d6 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 945 time: 0.1342862
Jun 01 18:52:07.989228 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:08.015206 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:08.016625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbc0310>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:08.073809 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-96910111-4137-4bc5-ad5f-99761766bd78 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "DELETE /v2.0/floatingips/bd83f58c-ab91-47f9-a413-2b0d622fc6e0 HTTP/1.1" status: 204  len: 168 time: 2.8659320
Jun 01 18:52:08.077208 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2a50b1f2-2cd2-40f5-afd0-eac19c40db8e req-1567438a-5047-45c3-a622-d17ca398f9c4 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0928001
Jun 01 18:52:08.077894 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:08.081080 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15c2d824-8564-4c19-9f4f-1848bd867579" -d '{"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:08.090451 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:08.114366 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '1151ad48-db08-470c-a31f-319eab029862', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:52:08.250833 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab05b536-ba0a-4c20-808b-8567743acc97 req-a8aa5e3d-0399-42ce-8694-64831ff3f23a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:08.252290 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab05b536-ba0a-4c20-808b-8567743acc97 req-a8aa5e3d-0399-42ce-8694-64831ff3f23a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0930090
Jun 01 18:52:08.303313 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:08.305775 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab05b536-ba0a-4c20-808b-8567743acc97 req-b355b055-96af-4915-85ae-9a037f003f6e tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0476921
Jun 01 18:52:08.346249 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:08.374055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4476944c-6bfa-4c8b-ad86-180b62d44dd4 x-openstack-request-id: req-4476944c-6bfa-4c8b-ad86-180b62d44dd4 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:08.374388 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:08.374683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-4476944c-6bfa-4c8b-ad86-180b62d44dd4 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:08.375651 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:52:08.424603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:52:08.514810 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:08.547628 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:08.568484 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:08.571075 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6221517-4c2f-4f64-a27f-9d1da6b6bcb8" -d '{"events": [{"server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "name": "network-vif-plugged", "status": "completed", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:08.579823 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:08.585366 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:08.630878 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:08.656752 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d84386b9-0587-4821-a2c1-5fdf25a05525 x-openstack-request-id: req-d84386b9-0587-4821-a2c1-5fdf25a05525 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:08.657164 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "name": "network-vif-plugged", "status": "completed", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:08.657613 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d84386b9-0587-4821-a2c1-5fdf25a05525 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:08.658097 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'code': 200}
Jun 01 18:52:08.670496 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:08.755444 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f65852f-4345-4475-8ed4-e0241642598c req-a8816e71-2c06-4c65-9edf-ee9c39422753 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:08.762350 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f65852f-4345-4475-8ed4-e0241642598c req-a8816e71-2c06-4c65-9edf-ee9c39422753 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0889153
Jun 01 18:52:08.776283 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:08.779402 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:08.789317 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-15bbcb50-d5ba-4de0-90f0-db1393238c41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.113s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:08.813488 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5f65852f-4345-4475-8ed4-e0241642598c req-a9f53a36-80d7-44dc-ab33-628b390d2701 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497229
Jun 01 18:52:08.894672 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:08.897744 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:08.926221 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbc0310>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:08.930017 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Checking router: dd23659b-80fb-4c76-accf-8fae6eeb1c47 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:08.938876 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:08.939489 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbc0310>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:09.117506 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:09.280374 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacf989f-f7bb-4940-b081-a2af4f6b71a8 req-78633831-b04e-42de-ab5f-70fccdf25a38 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:09.282432 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cacf989f-f7bb-4940-b081-a2af4f6b71a8 req-78633831-b04e-42de-ab5f-70fccdf25a38 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0885692
Jun 01 18:52:09.332460 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cacf989f-f7bb-4940-b081-a2af4f6b71a8 req-b910b646-b2d0-4722-a0ac-19ecdde57991 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405819
Jun 01 18:52:09.509544 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdbc0310>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:09.513500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f807fc-3474-434c-af25-ca44e3ad75a8 None None] The sync data for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi is: [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:49:21Z', 'revision_number': 4, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '1a05b744-420f-4fd3-b1fa-f937ac69b420', 'name': '', 'network_id': '4a9f474a-dc9d-475e-847d-0ea358045ed8', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'mac_address': 'fa:16:3e:44:9c:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:20Z', 'updated_at': '2021-06-01T18:49:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'subnets': [{'id': 'dead668a-1f23-483d-a130-8fd712cb633f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:09.521870 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585332f6-3b0e-4fd8-9f2c-ebb4779c7a94 req-c2454aa4-8004-4573-9f90-2bb4db7a82cb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:09.523784 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-585332f6-3b0e-4fd8-9f2c-ebb4779c7a94 req-c2454aa4-8004-4573-9f90-2bb4db7a82cb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0943966
Jun 01 18:52:09.571031 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-585332f6-3b0e-4fd8-9f2c-ebb4779c7a94 req-1207713a-07fb-4932-ac42-a8c745833dff tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406954
Jun 01 18:52:09.747843 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2f68009-b852-4404-b274-0ed1111240d7 None None] New status for floating IP bd83f58c-ab91-47f9-a413-2b0d622fc6e0: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:52:09.995560 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7281b49b-a2cb-4743-a3c8-e2e2c407f9b1 req-ec4df520-6765-43e5-a77a-413a8ab5a06b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:09.996982 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7281b49b-a2cb-4743-a3c8-e2e2c407f9b1 req-ec4df520-6765-43e5-a77a-413a8ab5a06b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0809338
Jun 01 18:52:10.040286 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7281b49b-a2cb-4743-a3c8-e2e2c407f9b1 req-63fd9d3c-4f64-4a54-97b9-696d38c00516 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0371192
Jun 01 18:52:10.514546 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e28f62-01c1-466f-abf6-40d3580ea7a6 req-229d437a-d294-493e-a4cf-a974256d31cd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:10.516003 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-80e28f62-01c1-466f-abf6-40d3580ea7a6 req-229d437a-d294-493e-a4cf-a974256d31cd tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0795357
Jun 01 18:52:10.560399 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-80e28f62-01c1-466f-abf6-40d3580ea7a6 req-cb897c92-d986-4bbc-bfee-8ebbaa8b75d7 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388286
Jun 01 18:52:10.755910 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-925a30f3-626a-4fc8-85b0-b4951ee69eed req-e744d99f-967c-4bdf-ac19-58a037354695 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:10.757401 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-925a30f3-626a-4fc8-85b0-b4951ee69eed req-e744d99f-967c-4bdf-ac19-58a037354695 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0806231
Jun 01 18:52:10.788257 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:10.849064 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-925a30f3-626a-4fc8-85b0-b4951ee69eed req-68be0671-c2e2-49cb-812e-59e3a8cc1a4c tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0859072
Jun 01 18:52:10.878707 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-91258a91-f98c-4066-96b5-0caf35c53766 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:10.880135 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-91258a91-f98c-4066-96b5-0caf35c53766 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 1098 time: 0.0873253
Jun 01 18:52:11.035420 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['1151ad48-db08-470c-a31f-319eab029862'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:11.067517 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a93f26eb-67a7-4121-80ae-b56703c54f4d req-ab12ff77-7206-4791-ad96-35eadb8678af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.069380 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a93f26eb-67a7-4121-80ae-b56703c54f4d req-ab12ff77-7206-4791-ad96-35eadb8678af service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 1099 time: 0.0806475
Jun 01 18:52:11.116175 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-a93f26eb-67a7-4121-80ae-b56703c54f4d req-69274164-309e-40f0-81ee-e5da67f39d64 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390570
Jun 01 18:52:11.131937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-f40b612e-4bbe-4d65-8d98-25f9e4514a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.133773 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-f40b612e-4bbe-4d65-8d98-25f9e4514a69 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 200  len: 914 time: 0.2470715
Jun 01 18:52:11.236388 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f91e50af-aadc-4ff6-8208-fbe2861fb9e7 req-24e56a02-f074-4def-900e-b68bf24f586f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.237864 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f91e50af-aadc-4ff6-8208-fbe2861fb9e7 req-24e56a02-f074-4def-900e-b68bf24f586f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0816717
Jun 01 18:52:11.247733 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-3184ca38-4f73-4bf4-8202-ccea91015c0d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 200  len: 217 time: 0.0623400
Jun 01 18:52:11.286288 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f91e50af-aadc-4ff6-8208-fbe2861fb9e7 req-e4b66f4e-1f1b-4e32-8a9b-4ee8d6bf97b3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426674
Jun 01 18:52:11.329349 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-9d6000c2-88b1-4dc7-8967-6a84fe8bc103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.330775 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-9d6000c2-88b1-4dc7-8967-6a84fe8bc103 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 200  len: 853 time: 0.0603936
Jun 01 18:52:11.404781 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-85869396-17ee-4fc6-9d78-f51aedaa571e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.406719 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-85869396-17ee-4fc6-9d78-f51aedaa571e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4a9f474a-dc9d-475e-847d-0ea358045ed8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0679953
Jun 01 18:52:11.534982 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-ca99762a-c558-40b9-85a9-ce26b85bf032 service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1201789
Jun 01 18:52:11.672971 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15c2d824-8564-4c19-9f4f-1848bd867579 req-b72bba53-1aca-4c6c-bb93-8e88167d581b service neutron] 10.222.0.25 "GET /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1297989
Jun 01 18:52:11.781797 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c97afbe-1bd8-4af8-a8c1-a163c2720dea req-fcbcd195-8844-4eaf-b309-e2f411f17803 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:11.784316 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c97afbe-1bd8-4af8-a8c1-a163c2720dea req-fcbcd195-8844-4eaf-b309-e2f411f17803 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.1143959
Jun 01 18:52:11.842368 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5c97afbe-1bd8-4af8-a8c1-a163c2720dea req-3a1db7f1-4061-4f01-b9d2-029fedeefd3d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0517690
Jun 01 18:52:12.041787 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1b85fc-4503-4645-af92-600ce19c6df5 req-1bc8af3c-e78a-4d91-9b49-91b38f6733f8 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:12.043600 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8e1b85fc-4503-4645-af92-600ce19c6df5 req-1bc8af3c-e78a-4d91-9b49-91b38f6733f8 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0850713
Jun 01 18:52:12.095456 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8e1b85fc-4503-4645-af92-600ce19c6df5 req-f92877dd-159b-4be1-98e5-468a19271acd tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461133
Jun 01 18:52:12.472928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d1c1dc-5b68-4079-9003-c77ba346ef15 req-29fb97f4-34e7-4b1c-80af-864f7b780c6c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:12.474356 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-83d1c1dc-5b68-4079-9003-c77ba346ef15 req-29fb97f4-34e7-4b1c-80af-864f7b780c6c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0793333
Jun 01 18:52:12.517824 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-83d1c1dc-5b68-4079-9003-c77ba346ef15 req-d7c67751-5231-428e-a20f-f869b3f9f0a7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380006
Jun 01 18:52:12.773966 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:12.841451 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 1151ad48-db08-470c-a31f-319eab029862 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:12.846145 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 1151ad48-db08-470c-a31f-319eab029862 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:12.846517 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:12.960939 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:12.987671 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:12.990180 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99249efc-1cad-4cc8-94d0-c1dbadfbf556" -d '{"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:13.002252 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:13.009541 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.012999 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:13.059165 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d89b4d13-ef1f-4f4e-bcd8-9f0551d54dbf x-openstack-request-id: req-d89b4d13-ef1f-4f4e-bcd8-9f0551d54dbf {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:13.059681 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:13.060007 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d89b4d13-ef1f-4f4e-bcd8-9f0551d54dbf {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:13.060483 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'code': 200}
Jun 01 18:52:13.068381 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778a5a42-2305-41e4-89a3-63df1a6df7a4 req-69877abe-2f22-4c08-b963-9c06a4700618 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:13.070739 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-778a5a42-2305-41e4-89a3-63df1a6df7a4 req-69877abe-2f22-4c08-b963-9c06a4700618 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.1079152
Jun 01 18:52:13.138450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:13.142985 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:13.151634 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-778a5a42-2305-41e4-89a3-63df1a6df7a4 req-7d31f145-0b6a-4cfe-b8f2-37a9c21af27b tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0697060
Jun 01 18:52:13.386112 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38604) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:13.405749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2859137-1bbe-4207-a1b9-7c2fef2c5754 req-875e2d6a-c703-4f32-ab3f-7f5d66188c78 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:13.407234 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2859137-1bbe-4207-a1b9-7c2fef2c5754 req-875e2d6a-c703-4f32-ab3f-7f5d66188c78 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1735339
Jun 01 18:52:13.409946 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab15b2a0-eecc-4f5e-8d5e-45fcc30051bd req-82d0effb-1782-4b99-b3e8-94e04aa9ab50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:13.411271 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab15b2a0-eecc-4f5e-8d5e-45fcc30051bd req-82d0effb-1782-4b99-b3e8-94e04aa9ab50 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1098 time: 0.1254990
Jun 01 18:52:13.505614 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2859137-1bbe-4207-a1b9-7c2fef2c5754 req-85c6f6f7-bfc1-49df-8a6b-ebdb68f72adc tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0842733
Jun 01 18:52:13.507117 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ab15b2a0-eecc-4f5e-8d5e-45fcc30051bd req-decf18ab-7a14-44ff-a87f-765883ee1c04 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0879021
Jun 01 18:52:13.528851 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79c25f1-abb0-4a07-a0da-a656bf87e315 req-37f5f18d-0af7-4edd-9660-d3cd8e869d32 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:13.530341 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d79c25f1-abb0-4a07-a0da-a656bf87e315 req-37f5f18d-0af7-4edd-9660-d3cd8e869d32 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0945990
Jun 01 18:52:13.538249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.539422 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38610) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:13.544158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Request body: {'floatingip': {'port_id': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:13.553700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:13.557646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Usage tracker for resource:security_group_rule and tenant:2218f2fba0dd4e50987394683f5cf7ae is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:13.560656 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:13.566408 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:13.626979 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.700981 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.705544 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.712778 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d0c547ef-587a-45a6-b065-fdb78c8403c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:13.765981 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=709f1d18-0226-4007-8451-25b997213d89,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:13.770135 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=2218f2fba0dd4e50987394683f5cf7ae&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3832831
Jun 01 18:52:13.771805 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:13.773750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38614) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:13.807980 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c01348de-00c0-4565-a9ae-2dee5f05ec90 req-d516a21e-2856-4ab2-8e3c-6fb903759785 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:13.809359 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c01348de-00c0-4565-a9ae-2dee5f05ec90 req-d516a21e-2856-4ab2-8e3c-6fb903759785 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.1732967
Jun 01 18:52:13.873638 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.885656 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c01348de-00c0-4565-a9ae-2dee5f05ec90 req-06014336-490d-42bb-8ace-7bbc9641a84d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0645092
Jun 01 18:52:13.908125 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.960889 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.966775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-df37d541-0a22-4919-9925-0fa9d58ab380 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:13.979258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=709f1d18-0226-4007-8451-25b997213d89,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:13.981588 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:13.985073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:13.986438 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/709f1d18-0226-4007-8451-25b997213d89 HTTP/1.1" status: 204  len: 168 time: 0.2116737
Jun 01 18:52:14.144765 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ef1b4a49-5fb1-4c94-bc1a-88d870887392 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.301564 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38622) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:14.321087 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.337570 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:14.341963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Usage tracker for resource:security_group_rule and tenant:5f9d57fc1d6847c3b515927f39e43b95 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:14.342281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.346519 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:14.349877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.353971 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:14.438560 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.443581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.451999 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9760c40b-2268-4fed-82c6-8a284421241c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:14.491293 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=5f9d57fc1d6847c3b515927f39e43b95&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1883726
Jun 01 18:52:14.492177 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e6cda8b-bf8c-4335-a8ff-38c6371d0cc1,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:14.494035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38624) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:14.495120 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:14.565779 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Floating IP 907c775f-989e-476e-b669-5010bd453179 associated. External IP: 172.27.0.83, port: 2fb95b17-86cc-49d3-8ae6-61048a81d7e9.
Jun 01 18:52:14.662237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.708216 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce00168-7ace-4f3d-b507-f6cbc64430ef req-dc7d70e7-8cdb-4a6b-af6e-ce98d39d3fbb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:14.709775 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ce00168-7ace-4f3d-b507-f6cbc64430ef req-dc7d70e7-8cdb-4a6b-af6e-ce98d39d3fbb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0945110
Jun 01 18:52:14.755405 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-2ce00168-7ace-4f3d-b507-f6cbc64430ef req-c2f34d82-1261-4580-bc19-a3f3acf6ac55 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397398
Jun 01 18:52:14.761382 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.898500 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.950014 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ab9b79fb-bd11-4367-bf0b-128c562515a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:14.978602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e6cda8b-bf8c-4335-a8ff-38c6371d0cc1,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:14.984831 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:14.987663 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:14.991008 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/3e6cda8b-bf8c-4335-a8ff-38c6371d0cc1 HTTP/1.1" status: 204  len: 168 time: 0.4938388
Jun 01 18:52:15.052110 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:15.174568 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dde8b8-e6b5-4560-af75-b55e15cf2f29 req-752e8378-0fa3-4180-b178-5b5461a9f320 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:15.176053 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-12dde8b8-e6b5-4560-af75-b55e15cf2f29 req-752e8378-0fa3-4180-b178-5b5461a9f320 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.1770613
Jun 01 18:52:15.299429 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-12dde8b8-e6b5-4560-af75-b55e15cf2f29 req-ad70f686-713b-488f-8174-0c600181e1a5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0714972
Jun 01 18:52:15.300581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:15.305192 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:15.317199 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:15.327247 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:15.327899 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0f6d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:15.369761 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5712704a-fcd5-43db-8565-5f0d3f90a58c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "PUT /v2.0/floatingips/907c775f-989e-476e-b669-5010bd453179 HTTP/1.1" status: 200  len: 991 time: 1.8262589
Jun 01 18:52:15.369761 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:15.376988 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d89ca3bb-3a8d-48af-b041-20c8241342fb" -d '{"events": [{"name": "network-changed", "server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:15.524603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd29cd6b-3436-47b7-81a3-31a6681a0750 req-f3925c7d-573e-4722-a2c8-17aef91fabab tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:15.526224 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-dd29cd6b-3436-47b7-81a3-31a6681a0750 req-f3925c7d-573e-4722-a2c8-17aef91fabab tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0911522
Jun 01 18:52:15.535214 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38656) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:15.539935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Request body: {'floatingip': {'port_id': '1151ad48-db08-470c-a31f-319eab029862'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:15.540090 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:15.605551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d461f70e-128a-4bfa-abe5-96c4e214024e x-openstack-request-id: req-d461f70e-128a-4bfa-abe5-96c4e214024e {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:15.606086 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:15.606325 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d461f70e-128a-4bfa-abe5-96c4e214024e {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:15.606634 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'status': 'completed', 'code': 200}
Jun 01 18:52:15.635446 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:15.704143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-fc01b1d6-39e8-4cd2-ac46-6fe2cf1783f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:15.705942 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-fc01b1d6-39e8-4cd2-ac46-6fe2cf1783f5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e471347ca004404f94563ac66c74dc87&device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 1099 time: 0.1039331
Jun 01 18:52:16.061832 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-b2cc4fb8-0699-4cc9-a675-213dd694a833 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:16.064716 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-b2cc4fb8-0699-4cc9-a675-213dd694a833 service neutron] 10.222.0.25 "GET /v2.0/networks?id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 200  len: 910 time: 0.3505690
Jun 01 18:52:16.064914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0f6d0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '907c775f-989e-476e-b669-5010bd453179', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.83', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:0e:e5:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:47Z', 'updated_at': '2021-06-01T18:52:14Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:16.073457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:16.086268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:16.087407 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0f6d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:51:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:16.201305 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406195e0-9282-43b4-8e11-1e15e13f9485 req-6a834e52-0859-46be-84a5-15c22ed6a069 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:16.209171 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-406195e0-9282-43b4-8e11-1e15e13f9485 req-6a834e52-0859-46be-84a5-15c22ed6a069 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.2633970
Jun 01 18:52:16.299387 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-406195e0-9282-43b4-8e11-1e15e13f9485 req-68d7d03f-1049-4100-a20f-11524a5ddc86 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0893970
Jun 01 18:52:16.307486 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-b0f24729-fae6-4796-a6ca-9ff9d8dbf59f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9 HTTP/1.1" status: 200  len: 999 time: 0.2338746
Jun 01 18:52:16.401663 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:16.411612 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-ed45d201-a7f9-4b04-83d0-34b0246a7299 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:16.413108 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-ed45d201-a7f9-4b04-83d0-34b0246a7299 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 200  len: 849 time: 0.0988612
Jun 01 18:52:16.500917 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-51285b03-01c6-4758-9589-5ff358ba7c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:16.502389 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-51285b03-01c6-4758-9589-5ff358ba7c8b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=87c3456d-8d78-42d4-81e0-1f541c3dcc2f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0792129
Jun 01 18:52:16.586295 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:16.590928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:16.678063 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-743e03c7-fe6a-417c-9d03-0a989f024141 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1686225
Jun 01 18:52:16.753196 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e6d2cf7f-d52b-43e9-831f-ddf4fe4e2d8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:16.826497 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Floating IP 3ad8f880-1c80-45af-b178-492b3ca12db8 associated. External IP: 172.27.0.124, port: 1151ad48-db08-470c-a31f-319eab029862.
Jun 01 18:52:16.885828 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:16.903607 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc0f6d0>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '907c775f-989e-476e-b669-5010bd453179', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.83', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:0e:e5:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:47Z', 'updated_at': '2021-06-01T18:52:14Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:16.907907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b947d584-b393-491d-b1f0-1c263248c0c1 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '907c775f-989e-476e-b669-5010bd453179', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'floating_ip_address': '172.27.0.83', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'port_id': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'mac_address': 'fa:16:3e:0e:e5:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:47Z', 'updated_at': '2021-06-01T18:52:14Z', 'revision_number': 1, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:16.939077 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d89ca3bb-3a8d-48af-b041-20c8241342fb req-f3b30ff5-b692-452e-87ab-21ee7eff9ab4 service neutron] 10.222.0.25 "GET /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2530828
Jun 01 18:52:17.108374 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56d2c929-6259-4622-9435-fcdeec730527 None None] New status for floating IP 907c775f-989e-476e-b669-5010bd453179: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:52:17.198706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:17.478580 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:17.483090 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:17.488914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:17.501960 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:17.502777 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd7469d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:17.556621 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-97d6040d-6371-4d04-a50e-b43e44cbf444 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "PUT /v2.0/floatingips/3ad8f880-1c80-45af-b178-492b3ca12db8 HTTP/1.1" status: 200  len: 991 time: 2.0203059
Jun 01 18:52:17.568380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84f6e091-d528-4615-92fd-c6136f5d2934 req-778bf114-3f60-4ffe-8289-46ef83e37a09 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:17.569939 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84f6e091-d528-4615-92fd-c6136f5d2934 req-778bf114-3f60-4ffe-8289-46ef83e37a09 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1585095
Jun 01 18:52:17.570989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38702) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:17.727563 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:17.730108 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b" -d '{"events": [{"name": "network-changed", "server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:17.744601 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:17.762956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:17.788842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:17.792666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Usage tracker for resource:security_group_rule and tenant:284ac1237f374fe5b929ca49ac5b499e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:17.795561 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:17.807060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:17.826128 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84f6e091-d528-4615-92fd-c6136f5d2934 req-62cabc92-1934-46c7-87b6-6e6b21a4c69e tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2445681
Jun 01 18:52:17.897761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:17.932706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7aff92cc-c6c5-49ca-b331-e245b08bdcd1 x-openstack-request-id: req-7aff92cc-c6c5-49ca-b331-e245b08bdcd1 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:17.933237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "tag": "1151ad48-db08-470c-a31f-319eab029862", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:17.933435 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7aff92cc-c6c5-49ca-b331-e245b08bdcd1 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:17.933809 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'status': 'completed', 'code': 200}
Jun 01 18:52:17.941479 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:17.947480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:17.957354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f29abab1-8f24-4ab2-b0fa-220ba57f1525 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:18.010498 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13de0ee1-e489-4492-a3a3-aa0c11c53d6a,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:18.021936 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.022347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.023008 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.023743 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.024186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.024644 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.025228 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.025687 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.026101 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.026511 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.026873 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.027232 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.032107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:18.039122 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=284ac1237f374fe5b929ca49ac5b499e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4669406
Jun 01 18:52:18.043274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38718) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:18.081596 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-15ae0ebc-4c85-4b71-b488-6c569db9da29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:18.083023 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-15ae0ebc-4c85-4b71-b488-6c569db9da29 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1098 time: 0.1313102
Jun 01 18:52:18.200881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd7469d0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '3ad8f880-1c80-45af-b178-492b3ca12db8', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:41Z', 'updated_at': '2021-06-01T18:52:16Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:18.205050 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:18.213660 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:18.214291 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd7469d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:18.214421 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:18.264196 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:18.274868 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-659cd971-c45a-45f5-a995-c8b30dc064dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:18.276314 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-659cd971-c45a-45f5-a995-c8b30dc064dd service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.1819587
Jun 01 18:52:18.386384 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-c0764f22-0999-44c8-b39b-d655a796af75 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 999 time: 0.1009789
Jun 01 18:52:18.394429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:18.458383 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-429aede6-6fa6-45fa-9c39-531e203951c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:18.459898 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-429aede6-6fa6-45fa-9c39-531e203951c1 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.0632639
Jun 01 18:52:18.503557 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:18.512296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-02936db4-9c72-40b2-9a2e-484b8f17768a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:18.527352 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13de0ee1-e489-4492-a3a3-aa0c11c53d6a,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:18.542210 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.542582 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.542944 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.543306 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.543656 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.544005 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.544348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.544717 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.545062 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.545402 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.545742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.546081 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:18.554416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:18.558299 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:18.559423 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-5233a703-ac1e-496e-b327-77e204bad4b7 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/13de0ee1-e489-4492-a3a3-aa0c11c53d6a HTTP/1.1" status: 204  len: 168 time: 0.5152028
Jun 01 18:52:18.578515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-98d8a83b-74d8-4269-a9d2-d73579973080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:18.580126 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-98d8a83b-74d8-4269-a9d2-d73579973080 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1133025
Jun 01 18:52:18.808466 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd7469d0>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '3ad8f880-1c80-45af-b178-492b3ca12db8', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:41Z', 'updated_at': '2021-06-01T18:52:16Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:18.812825 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f7de6ae-7940-4a4f-935d-a8ba61ecd141 None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '3ad8f880-1c80-45af-b178-492b3ca12db8', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:51:41Z', 'updated_at': '2021-06-01T18:52:16Z', 'revision_number': 1, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:19.003117 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d91539d2-479d-45b4-a53e-3260a9abf529 None None] New status for floating IP 3ad8f880-1c80-45af-b178-492b3ca12db8: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:52:19.214574 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924fd922-1c54-45d1-aec6-6d8b5c313392 req-d2fe7963-a88f-44f9-b04d-36a3720092cf tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:19.216062 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-924fd922-1c54-45d1-aec6-6d8b5c313392 req-d2fe7963-a88f-44f9-b04d-36a3720092cf tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.2805822
Jun 01 18:52:19.261699 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-924fd922-1c54-45d1-aec6-6d8b5c313392 req-066059c9-a0e6-4cce-8112-731ffc45f63e tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390854
Jun 01 18:52:19.508603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:21.480665 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-810ecbd4-b966-4752-810d-18482b3a5169 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1321449
Jun 01 18:52:21.570731 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158d7655-1ccb-4bce-8337-b0be1eeb29a6 req-a102f5c4-f8b4-4444-87b7-34fe15862108 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:21.572213 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-158d7655-1ccb-4bce-8337-b0be1eeb29a6 req-a102f5c4-f8b4-4444-87b7-34fe15862108 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0895138
Jun 01 18:52:21.617623 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-158d7655-1ccb-4bce-8337-b0be1eeb29a6 req-4ade3480-bd61-44bb-ad13-6cbe02fe2304 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384817
Jun 01 18:52:21.666254 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c6148f0e-bae5-4f5c-b15b-dae2ebd95a3b req-0b87b6c0-0bfd-4602-94b0-e0eab1868f26 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1746020
Jun 01 18:52:21.687250 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30064b48-c6da-4538-99e7-d1048acf8b89 req-d4aee996-dcfe-44be-8332-0180f1783686 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:21.689309 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-30064b48-c6da-4538-99e7-d1048acf8b89 req-d4aee996-dcfe-44be-8332-0180f1783686 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.2049987
Jun 01 18:52:21.737079 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-30064b48-c6da-4538-99e7-d1048acf8b89 req-d69cad68-787b-4e11-85c2-da39e2f62273 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419998
Jun 01 18:52:22.810508 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c0ad26-91b1-4f49-aec4-563b7f9e43eb req-4bef3c58-51e6-433f-9548-b18d9f175b62 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:22.813522 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90c0ad26-91b1-4f49-aec4-563b7f9e43eb req-4bef3c58-51e6-433f-9548-b18d9f175b62 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0879831
Jun 01 18:52:22.860378 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90c0ad26-91b1-4f49-aec4-563b7f9e43eb req-3a1d00aa-b385-44ca-afc0-3508f4e8f5b9 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404770
Jun 01 18:52:23.026964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d623da7-0eb0-4530-a3d9-511036451003 req-38875faa-d4e2-4a3b-b03b-13fe03fd08e2 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:23.028384 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d623da7-0eb0-4530-a3d9-511036451003 req-38875faa-d4e2-4a3b-b03b-13fe03fd08e2 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1567831
Jun 01 18:52:23.071622 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d623da7-0eb0-4530-a3d9-511036451003 req-af43bdc9-a727-4454-ab63-e89acf3e503f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375557
Jun 01 18:52:26.273070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d110ba-a3a1-409d-a673-42f476c433a6 req-cb249ff7-6f1c-4423-91f5-11b292e9dd7a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.274773 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f7d110ba-a3a1-409d-a673-42f476c433a6 req-cb249ff7-6f1c-4423-91f5-11b292e9dd7a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0817127
Jun 01 18:52:26.278688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-d6c43bdc-4a3c-4fae-8b67-97a0437b3dab tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.279386 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-d6c43bdc-4a3c-4fae-8b67-97a0437b3dab tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:26.295019 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-d6c43bdc-4a3c-4fae-8b67-97a0437b3dab tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:26.296978 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-d6c43bdc-4a3c-4fae-8b67-97a0437b3dab tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1006413
Jun 01 18:52:26.341981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-77c498d7-24b8-4bf1-aab9-2e1cdb1d34a1 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Synchronizing usage tracker for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:52:26.357725 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-77c498d7-24b8-4bf1-aab9-2e1cdb1d34a1 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Unset dirty status for tenant:35f75df4cb564b1dad14fd0d02d3c46b on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:52:26.358861 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef60ca0c-56d4-4fcd-beaf-c1ecbfcd81e9 req-77c498d7-24b8-4bf1-aab9-2e1cdb1d34a1 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/security-groups?id=9ec7d009-a5f3-4e97-b404-46080b7ac538&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0565593
Jun 01 18:52:26.368871 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f7d110ba-a3a1-409d-a673-42f476c433a6 req-e532d97b-6231-4f68-96a6-1552ae164642 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0881851
Jun 01 18:52:26.413967 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-326936cc-779a-4c4f-bdb3-6b388e52c094 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.415396 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-326936cc-779a-4c4f-bdb3-6b388e52c094 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.25 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 945 time: 0.1087906
Jun 01 18:52:26.553400 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Deleting port 57350594-9e66-45d7-9d43-cd9828eb72bb {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:26.553742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:26.576236 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-e0c539ed-cf63-4d6f-b904-d2bfcd2da559 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.577753 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-e0c539ed-cf63-4d6f-b904-d2bfcd2da559 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.0704041
Jun 01 18:52:26.683955 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] For port 57350594-9e66-45d7-9d43-cd9828eb72bb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=57350594-9e66-45d7-9d43-cd9828eb72bb,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:26.684316 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:26.710820 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-120fa7b2-10d4-4fca-b3cc-bbedd7420729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.712272 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-120fa7b2-10d4-4fca-b3cc-bbedd7420729 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.1249180
Jun 01 18:52:26.812919 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Calling delete_port for 57350594-9e66-45d7-9d43-cd9828eb72bb owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:26.816528 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-85837e91-07ce-45aa-9529-8ce47a721a1d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 1001 time: 0.0964248
Jun 01 18:52:26.890208 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-7b647dd9-4b99-4773-bce4-f300f2c24f5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.892299 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-7b647dd9-4b99-4773-bce4-f300f2c24f5b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0611858
Jun 01 18:52:26.920614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:26.925996 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:26.933828 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['57350594-9e66-45d7-9d43-cd9828eb72bb'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:26.972351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-e4634c71-ea4e-461d-821c-89fbd3f6fd7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:26.973891 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-e4634c71-ea4e-461d-821c-89fbd3f6fd7f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0746865
Jun 01 18:52:26.974126 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Pushing event deleted for resources: {'Port': ['ID=57350594-9e66-45d7-9d43-cd9828eb72bb,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:26.977706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:27.052036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] No DVR routers for this DVR port 57350594-9e66-45d7-9d43-cd9828eb72bb on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:52:27.054588 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:27.057095 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'name': 'network-vif-deleted', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:27.059344 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dacbeef8-dfc1-45b0-94dc-0d6d83ca1c97" -d '{"events": [{"server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "name": "network-vif-deleted", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:27.079193 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ea0cd9d-7823-4154-af03-b58c4ae93d57 req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.25 "DELETE /v2.0/ports/57350594-9e66-45d7-9d43-cd9828eb72bb HTTP/1.1" status: 204  len: 173 time: 0.6534452
Jun 01 18:52:27.112388 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2192ec7c-30b4-4f66-bd79-fef5a18ee491 x-openstack-request-id: req-2192ec7c-30b4-4f66-bd79-fef5a18ee491 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:27.112947 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9bfc291-f512-4e55-83d0-9382f1ac47df", "name": "network-vif-deleted", "tag": "57350594-9e66-45d7-9d43-cd9828eb72bb", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:27.113417 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-2192ec7c-30b4-4f66-bd79-fef5a18ee491 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:27.114048 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9bfc291-f512-4e55-83d0-9382f1ac47df', 'name': 'network-vif-deleted', 'tag': '57350594-9e66-45d7-9d43-cd9828eb72bb', 'status': 'completed', 'code': 200}
Jun 01 18:52:27.135717 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-fa39b649-6a3c-4e72-a5c6-ec356a8f289d service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1543686
Jun 01 18:52:27.298281 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3df41202-c6b6-43e5-8252-dd4c0a2bb45d req-74bdf5c2-e3d9-423b-8ddb-461dea683e0f service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1556716
Jun 01 18:52:27.528195 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab933677-e7ba-473e-91c7-3fd4c889db4b req-71d6b7be-b157-4fb0-b357-5bba01b4c9a5 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] 10.222.0.22 "GET /v2.0/ports?device_id=f9bfc291-f512-4e55-83d0-9382f1ac47df HTTP/1.1" status: 200  len: 210 time: 0.0439761
Jun 01 18:52:27.571827 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b422cf9-0328-4c28-a57c-15d9e9f2f9d7 req-55341862-5d58-4966-9184-8117b37d1c4d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:27.575617 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9b422cf9-0328-4c28-a57c-15d9e9f2f9d7 req-55341862-5d58-4966-9184-8117b37d1c4d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0989306
Jun 01 18:52:27.617853 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9b422cf9-0328-4c28-a57c-15d9e9f2f9d7 req-4c0a3b9e-dafd-4655-846c-1cf68bf12dc5 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396130
Jun 01 18:52:28.831012 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d138fe4-0e86-477b-bff7-692cf2e791a2 req-65c89566-8064-4bdf-acbe-8194de903615 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:28.832742 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4d138fe4-0e86-477b-bff7-692cf2e791a2 req-65c89566-8064-4bdf-acbe-8194de903615 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0983882
Jun 01 18:52:28.882547 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4d138fe4-0e86-477b-bff7-692cf2e791a2 req-83b922f0-3c7a-42d8-84be-6dcf81017245 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425618
Jun 01 18:52:29.445969 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38862) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:30.147842 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaced182-efde-4d84-95cd-34c621383c09 req-ad6f9bc6-f9cf-450a-96de-f82d6e464010 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:30.149583 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-eaced182-efde-4d84-95cd-34c621383c09 req-ad6f9bc6-f9cf-450a-96de-f82d6e464010 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1384404
Jun 01 18:52:30.185951 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:30.278090 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-eaced182-efde-4d84-95cd-34c621383c09 req-b4531aa6-9b16-4708-9f83-3ae4993d7f13 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1216137
Jun 01 18:52:30.557186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38884) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:30.679466 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-dbce47a5-c950-4ebf-924e-bbd4bbda5ddf service neutron] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1210644
Jun 01 18:52:30.705058 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1912923-c805-415a-9ee7-ccdc8e1c5afe req-cb136efc-24f8-4c7b-95ca-6bb8be68a70a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:30.706497 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1912923-c805-415a-9ee7-ccdc8e1c5afe req-cb136efc-24f8-4c7b-95ca-6bb8be68a70a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1336627
Jun 01 18:52:30.708663 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Deleting port 1a05b744-420f-4fd3-b1fa-f937ac69b420 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:30.708998 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:30.826825 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1912923-c805-415a-9ee7-ccdc8e1c5afe req-29b06efc-24e2-445c-9a51-e90b586a1a28 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1047301
Jun 01 18:52:30.864506 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] For port 1a05b744-420f-4fd3-b1fa-f937ac69b420, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=1a05b744-420f-4fd3-b1fa-f937ac69b420,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:30.864978 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:30.998069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Calling delete_port for 1a05b744-420f-4fd3-b1fa-f937ac69b420 owned by network:router_interface {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:31.278388 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:31.282658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:31.323399 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Pushing event deleted for resources: {'Port': ['ID=1a05b744-420f-4fd3-b1fa-f937ac69b420,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:31.326455 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:31.671435 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:32.020327 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Router dd23659b-80fb-4c76-accf-8fae6eeb1c47 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:32.198786 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:32.207544 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Sync routers for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:32.211036 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] 10.222.0.22 "PUT /v2.0/routers/dd23659b-80fb-4c76-accf-8fae6eeb1c47/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7640116
Jun 01 18:52:32.213446 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38904) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:32.216772 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:32.217460 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaae0a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:32.224039 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:52:32.383204 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks [] for router, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:32.394821 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:32.553976 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:32.623136 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Deleting port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:32.623476 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:32.673220 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaae0a0>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188'}], 'enable_snat': True}, 'gw_port_id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:52:31Z', 'revision_number': 5, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port': {'id': 'dfeb3118-dc47-46a1-89e0-71ed3cdf9efd', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:78:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:16Z', 'updated_at': '2021-06-01T18:49:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:32.676984 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Checking router: dd23659b-80fb-4c76-accf-8fae6eeb1c47 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:32.685285 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Routers {'dd23659b-80fb-4c76-accf-8fae6eeb1c47'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:32.685864 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaae0a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:32.837118 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] Set router dd23659b-80fb-4c76-accf-8fae6eeb1c47 gateway port host: None {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:32.854003 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] For port dfeb3118-dc47-46a1-89e0-71ed3cdf9efd, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:32.854368 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:32.941022 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaae0a0>, [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:52:32Z', 'revision_number': 6, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:32.944885 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c905259-add4-4d4d-af55-2b06b97717ba None None] The sync data for ids ['dd23659b-80fb-4c76-accf-8fae6eeb1c47'] in dv-cinder-794021-1-iscsi is: [{'id': 'dd23659b-80fb-4c76-accf-8fae6eeb1c47', 'name': 'tempest-TestMinimumBasicScenario-415914440-router', 'tenant_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:15Z', 'updated_at': '2021-06-01T18:52:32Z', 'revision_number': 6, 'project_id': '35f75df4cb564b1dad14fd0d02d3c46b', 'gw_port_host': None}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:32.980966 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Calling delete_port for dfeb3118-dc47-46a1-89e0-71ed3cdf9efd owned by network:router_gateway {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:33.122016 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.126611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c7933a18-8e3a-48e4-8d71-03825631cf96 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:33.168221 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Pushing event deleted for resources: {'Port': ['ID=dfeb3118-dc47-46a1-89e0-71ed3cdf9efd,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:33.170668 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:33.255826 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 57350594-9e66-45d7-9d43-cd9828eb72bb no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:33.259516 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.319937 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 57350594-9e66-45d7-9d43-cd9828eb72bb {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:33.320289 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 57350594-9e66-45d7-9d43-cd9828eb72bb not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:33.330481 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:33.479278 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.482264 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.495381 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.526185 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:33.528724 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7685ce3e-0e0f-434b-af7a-1327a0da1884" -d '{"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-unplugged", "status": "completed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:33.551323 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:33.560864 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.561935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9578beb0-0b4f-4ed2-bb6e-2a03b056b537 req-0fcca2f0-6ff0-4899-ab76-6410aede57e6 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:33.563921 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:33.564158 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9578beb0-0b4f-4ed2-bb6e-2a03b056b537 req-0fcca2f0-6ff0-4899-ab76-6410aede57e6 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1041527
Jun 01 18:52:33.592671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.593424 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Fanout notify agent at l3_agent the message router_deleted on router dd23659b-80fb-4c76-accf-8fae6eeb1c47 {{(pid=98259) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:52:33.607611 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f68cf10c-d11a-4acc-abc6-729a5a3ca4d5 x-openstack-request-id: req-f68cf10c-d11a-4acc-abc6-729a5a3ca4d5 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:33.607924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-unplugged", "status": "failed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "code": 422}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:33.608187 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-f68cf10c-d11a-4acc-abc6-729a5a3ca4d5 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:33.608644 dv-cinder-794021-1-iscsi neutron-server[98260]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'code': 422} returned with failed status
Jun 01 18:52:33.608838 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.610101 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] 10.222.0.22 "DELETE /v2.0/routers/dd23659b-80fb-4c76-accf-8fae6eeb1c47 HTTP/1.1" status: 204  len: 168 time: 1.3956501
Jun 01 18:52:33.612389 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38912) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:33.619599 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9578beb0-0b4f-4ed2-bb6e-2a03b056b537 req-b4da5809-9c03-44c9-89cf-a6bd0d06a004 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0483096
Jun 01 18:52:33.651722 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=6']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:33.654952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:33.679048 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Deleting subnet dead668a-1f23-483d-a130-8fd712cb633f {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:52:33.681863 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.735334 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:33.859643 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.111875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.116933 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:34.151188 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dead668a-1f23-483d-a130-8fd712cb633f,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:34.153175 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.155645 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:34.162068 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-9d7f0bc3-ec3e-409a-bbb9-17f1a3e12bb3 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/dead668a-1f23-483d-a130-8fd712cb633f HTTP/1.1" status: 204  len: 168 time: 0.5465043
Jun 01 18:52:34.162223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82c5b70c-1026-445d-a7f1-1083293f024f None None] Network 4a9f474a-dc9d-475e-847d-0ea358045ed8 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:34.162330 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38914) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:34.270300 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.291226 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device dfeb3118-dc47-46a1-89e0-71ed3cdf9efd no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:34.342450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: dfeb3118-dc47-46a1-89e0-71ed3cdf9efd {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:34.342898 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device dfeb3118-dc47-46a1-89e0-71ed3cdf9efd not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:34.343430 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1a05b744-420f-4fd3-b1fa-f937ac69b420 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:34.450450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 1a05b744-420f-4fd3-b1fa-f937ac69b420 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:34.451305 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 1a05b744-420f-4fd3-b1fa-f937ac69b420 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:34.475692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Deleting port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:34.476035 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.598027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] For port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:34.598384 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.618611 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] DHCP port deletion for 4a9f474a-dc9d-475e-847d-0ea358045ed8 request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:52:34.692352 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Deleting port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:34.692788 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.736310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Calling delete_port for d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 owned by network:dhcp {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:34.795696 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.803049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:34.810813 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] For port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,segment=NetworkSegment(86c79fa1-5094-40ad-b6c7-ef8a27fb32b7),segment_id=86c79fa1-5094-40ad-b6c7-ef8a27fb32b7)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:34.811243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:34.854483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Pushing event deleted for resources: {'Port': ['ID=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:34.856538 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] No DVR routers for this DVR port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 on host dv-cinder-794021-1-iscsi {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:52:34.858740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:34.960701 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Calling delete_port for d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:34.999399 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.014909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd310d90>,) {'filters': {'network_id': ['4a9f474a-dc9d-475e-847d-0ea358045ed8']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:35.030952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd310d90>, '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:35.031403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd310d90>, '86c79fa1-5094-40ad-b6c7-ef8a27fb32b7') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:35.045414 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.059489 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd99c362-67f1-4929-8fc5-cc573346961e req-9a3e16f6-fb45-4548-a91f-8a54ade01209 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.076184 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bd99c362-67f1-4929-8fc5-cc573346961e req-9a3e16f6-fb45-4548-a91f-8a54ade01209 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.3401017
Jun 01 18:52:35.076397 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.085922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Releasing vlan 67 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:52:35.086675 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:52:35.106612 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:52:35.138040 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.150873 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:35.152968 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bd99c362-67f1-4929-8fc5-cc573346961e req-218a617e-f09e-4865-aea3-11ba9efe0d35 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0758414
Jun 01 18:52:35.176583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-882c0ae6-7c07-420b-aa44-f100b5c63fab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.178247 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-882c0ae6-7c07-420b-aa44-f100b5c63fab service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11&tenant_id=85f17a1d02ae4454a980be1331cbe34d HTTP/1.1" status: 200  len: 1096 time: 0.3878596
Jun 01 18:52:35.202562 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Pushing event deleted for resources: {'Port': ['ID=d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:35.205093 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.205928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:35.207157 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] No DVR routers for this DVR port d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:52:35.208964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:35.226982 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.239513 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Pushing event deleted for resources: {'Network': ['ID=4a9f474a-dc9d-475e-847d-0ea358045ed8,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:35.243571 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:35.253129 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] 10.222.0.22 "DELETE /v2.0/networks/4a9f474a-dc9d-475e-847d-0ea358045ed8 HTTP/1.1" status: 204  len: 168 time: 1.0866969
Jun 01 18:52:35.253324 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38932) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:35.291111 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-94551f70-22b8-45dd-ba2f-bbfb0cd312d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.292614 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-94551f70-22b8-45dd-ba2f-bbfb0cd312d4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1096 time: 0.0882649
Jun 01 18:52:35.423497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-5c042c4f-77f6-41a2-abd9-a3e0817ad26d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.424954 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-5c042c4f-77f6-41a2-abd9-a3e0817ad26d service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.1255109
Jun 01 18:52:35.530240 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-ad19c90b-71d0-4bc5-b2b9-79e8b1250b04 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 999 time: 0.0979667
Jun 01 18:52:35.611683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-65a28de2-0dfa-45be-bab9-14f19ccbe418 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.613314 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-65a28de2-0dfa-45be-bab9-14f19ccbe418 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0744646
Jun 01 18:52:35.700367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-8c55dce0-13cc-4752-9233-c886c9707017 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:35.701869 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-8c55dce0-13cc-4752-9233-c886c9707017 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0716860
Jun 01 18:52:35.792667 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:35.834087 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-f78395dd-a49f-4432-a4fe-1428905298f4 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1236360
Jun 01 18:52:35.963882 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b93f042-94d3-405f-b8d4-f52f73702921 req-49b2cf3d-3baf-42ca-9c02-2e1fee5e2238 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1224561
Jun 01 18:52:36.204714 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:36.243234 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:36.243972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d42e95db-e0d9-42ef-8aa0-7c7325c9e7c5 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:36.373059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Deleting port 4253cb22-c78c-4cb6-8246-3860c05dfd90 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:36.373617 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:36.413490 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7342c91d-ee68-4373-815b-5e337ac2a8f3 req-39186f9b-380c-4071-8d22-1c30932cb899 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:36.414915 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7342c91d-ee68-4373-815b-5e337ac2a8f3 req-39186f9b-380c-4071-8d22-1c30932cb899 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.1352928
Jun 01 18:52:36.527989 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7342c91d-ee68-4373-815b-5e337ac2a8f3 req-1894bcbe-7e81-487f-b1e8-234632711288 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1068759
Jun 01 18:52:36.548700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] For port 4253cb22-c78c-4cb6-8246-3860c05dfd90, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=4253cb22-c78c-4cb6-8246-3860c05dfd90,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:36.549059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:36.669991 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Calling delete_port for 4253cb22-c78c-4cb6-8246-3860c05dfd90 owned by network:router_interface {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:36.831062 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:36.835369 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f514a0f0-355f-4547-bea6-225bfceb6a5b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:36.877594 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Pushing event deleted for resources: {'Port': ['ID=4253cb22-c78c-4cb6-8246-3860c05dfd90,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:36.904453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:37.147302 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:37.595385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Router 1b85b9f8-dc37-4e55-a487-327bd03cc314 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:37.727151 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12b956a-5107-4851-a425-b850a34dfbc5 req-b6b8a97f-7e54-4667-8133-edf16a5a3efe tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:37.728851 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c12b956a-5107-4851-a425-b850a34dfbc5 req-b6b8a97f-7e54-4667-8133-edf16a5a3efe tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.0936995
Jun 01 18:52:37.780909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:37.788176 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c12b956a-5107-4851-a425-b850a34dfbc5 req-6764aa86-9cc2-4707-b380-292485ed8485 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0534184
Jun 01 18:52:37.792015 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Sync routers for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:37.805196 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:37.805824 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9506a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:37.818261 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] 10.222.0.22 "PUT /v2.0/routers/1b85b9f8-dc37-4e55-a487-327bd03cc314/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5617859
Jun 01 18:52:37.819059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38968) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:38.033245 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:38.039182 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks [] for router, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:38.216041 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:38.289003 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Deleting port 8b8474fc-cdc4-4213-9f90-4b017b63dded {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:38.289341 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:38.322894 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9506a0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178'}], 'enable_snat': True}, 'gw_port_id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:52:36Z', 'revision_number': 5, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port': {'id': '8b8474fc-cdc4-4213-9f90-4b017b63dded', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:37:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 361, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:49:27Z', 'updated_at': '2021-06-01T18:49:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:38.326637 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Checking router: 1b85b9f8-dc37-4e55-a487-327bd03cc314 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:38.334861 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Routers {'1b85b9f8-dc37-4e55-a487-327bd03cc314'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:38.335454 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9506a0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['1b85b9f8-dc37-4e55-a487-327bd03cc314'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:38.408592 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] For port 8b8474fc-cdc4-4213-9f90-4b017b63dded, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8b8474fc-cdc4-4213-9f90-4b017b63dded,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:38.408954 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:38.485587 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] Set router 1b85b9f8-dc37-4e55-a487-327bd03cc314 gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:38.527743 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Calling delete_port for 8b8474fc-cdc4-4213-9f90-4b017b63dded owned by network:router_gateway {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:38.589690 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd9506a0>, [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:52:38Z', 'revision_number': 6, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:38.593603 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46150e4b-a7c1-461c-81bd-7f6885d797fa None None] The sync data for ids ['1b85b9f8-dc37-4e55-a487-327bd03cc314'] in dv-cinder-794021-1-iscsi is: [{'id': '1b85b9f8-dc37-4e55-a487-327bd03cc314', 'name': 'tempest-TestMinimumBasicScenario-1169787598-router', 'tenant_id': '742cd095d98847558adeaa435437024e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:49:26Z', 'updated_at': '2021-06-01T18:52:38Z', 'revision_number': 6, 'project_id': '742cd095d98847558adeaa435437024e', 'gw_port_host': None}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:38.662840 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:38.666321 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d127dfd3-8a28-4ecc-b6de-b3b150dff920 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:38.707793 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Pushing event deleted for resources: {'Port': ['ID=8b8474fc-cdc4-4213-9f90-4b017b63dded,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:38.710865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:38.799484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.135297 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.138419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.173931 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.174412 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1b85b9f8-dc37-4e55-a487-327bd03cc314 {{(pid=98259) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:52:39.195581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-763dbc15-2ab6-4174-b776-43bcb1d46fdc req-6aa42ca4-3c54-47c2-a1c6-010b7f8bffa4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:39.197047 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-763dbc15-2ab6-4174-b776-43bcb1d46fdc req-6aa42ca4-3c54-47c2-a1c6-010b7f8bffa4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.2974896
Jun 01 18:52:39.200854 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.202184 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-805b0845-e670-4b91-881e-d63e4419668d admin admin] 10.222.0.22 "DELETE /v2.0/routers/1b85b9f8-dc37-4e55-a487-327bd03cc314 HTTP/1.1" status: 204  len: 168 time: 1.3825731
Jun 01 18:52:39.205634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38988) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:39.293020 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-763dbc15-2ab6-4174-b776-43bcb1d46fdc req-1d777fb3-9087-46a4-8973-d5b4d038d15a tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0892122
Jun 01 18:52:39.297805 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Deleting subnet 2051909f-1c03-4f79-b469-2b5fd38c2cd4 {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:52:39.300979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.354232 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.440629 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.482326 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 38994) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:39.617536 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.632974 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:39.640179 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Usage tracker for resource:security_group_rule and tenant:69d7318eaef84f42a0a599f3778db153 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:39.643828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:39.650031 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:39.701792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.707310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:39.746635 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2051909f-1c03-4f79-b469-2b5fd38c2cd4,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:39.749595 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:39.751252 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.757293 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-6bfe6bc8-a843-4c49-8f90-e4b2c3175c45 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/2051909f-1c03-4f79-b469-2b5fd38c2cd4 HTTP/1.1" status: 204  len: 168 time: 0.5388761
Jun 01 18:52:39.758003 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4219ffe6-4f8f-4512-9802-787840807f61 None None] Network 670539f1-1de1-4f09-80bf-a0edd1cf2a6e requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:39.759694 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 38998) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:39.759839 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.766556 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.777950 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5880ffa8-693c-4e38-a498-8ecd19fb1811 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:39.819315 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=69d7318eaef84f42a0a599f3778db153&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3333287
Jun 01 18:52:39.819515 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39000) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:39.829898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=036850f4-95e3-4b58-af92-4e4371b0a8cc,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:39.837042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:39.866482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.901011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.926831 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.947982 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Deleting port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:39.948484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.981647 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:39.987470 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c6642457-bebc-4c32-a22c-b6d4115b23bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:39.999880 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=036850f4-95e3-4b58-af92-4e4371b0a8cc,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:40.002750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:40.011640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.015275 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3a5fc9ff-6daf-44d1-8f15-94976a9e9efe admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/036850f4-95e3-4b58-af92-4e4371b0a8cc HTTP/1.1" status: 204  len: 168 time: 0.1926022
Jun 01 18:52:40.034175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] DHCP port deletion for 670539f1-1de1-4f09-80bf-a0edd1cf2a6e request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:52:40.058086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] For port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:40.058453 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.104035 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Deleting port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:52:40.104441 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.227988 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] For port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,segment=NetworkSegment(f8613a04-61a1-4be3-8e1e-105a7c0512c1),segment_id=f8613a04-61a1-4be3-8e1e-105a7c0512c1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:40.228927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.235794 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Calling delete_port for ef79ecbf-493f-47d9-8366-f7e25ab3bdfa owned by network:dhcp {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:40.298953 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.304542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:40.329850 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 4253cb22-c78c-4cb6-8246-3860c05dfd90 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:40.361324 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Pushing event deleted for resources: {'Port': ['ID=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:40.365001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:40.367456 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] No DVR routers for this DVR port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa on host dv-cinder-794021-1-iscsi {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:52:40.424377 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Calling delete_port for ef79ecbf-493f-47d9-8366-f7e25ab3bdfa owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:52:40.432882 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 4253cb22-c78c-4cb6-8246-3860c05dfd90 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:40.433311 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 4253cb22-c78c-4cb6-8246-3860c05dfd90 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:40.433816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device ef79ecbf-493f-47d9-8366-f7e25ab3bdfa no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:40.470777 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: ef79ecbf-493f-47d9-8366-f7e25ab3bdfa {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:40.471144 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device ef79ecbf-493f-47d9-8366-f7e25ab3bdfa not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:40.471552 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8b8474fc-cdc4-4213-9f90-4b017b63dded no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:52:40.486477 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.496293 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1502b19-90c4-4100-b072-1d60226476c3 req-66f57d19-8965-4d24-9721-5dfe17cc8443 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:40.497938 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1502b19-90c4-4100-b072-1d60226476c3 req-66f57d19-8965-4d24-9721-5dfe17cc8443 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.0804896
Jun 01 18:52:40.498962 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd236b50>,) {'filters': {'network_id': ['670539f1-1de1-4f09-80bf-a0edd1cf2a6e']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:40.511578 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd236b50>, 'f8613a04-61a1-4be3-8e1e-105a7c0512c1') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:40.511874 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd236b50>, 'f8613a04-61a1-4be3-8e1e-105a7c0512c1') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:40.524481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.542337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.549096 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e1502b19-90c4-4100-b072-1d60226476c3 req-3063bbf2-3011-44be-9438-00e3c8675a19 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455520
Jun 01 18:52:40.550587 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Releasing vlan 62 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:52:40.551134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.551561 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 8b8474fc-cdc4-4213-9f90-4b017b63dded {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:52:40.551982 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8b8474fc-cdc4-4213-9f90-4b017b63dded not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:52:40.564926 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:52:40.585346 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.589815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-50a68a71-7cdd-4231-bd21-6e260ea2d939 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:40.632024 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Pushing event deleted for resources: {'Port': ['ID=ef79ecbf-493f-47d9-8366-f7e25ab3bdfa,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:40.633843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] No DVR routers for this DVR port ef79ecbf-493f-47d9-8366-f7e25ab3bdfa on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:52:40.635169 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:40.644742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.649849 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.652274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:40.680769 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Pushing event deleted for resources: {'Network': ['ID=670539f1-1de1-4f09-80bf-a0edd1cf2a6e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:40.683222 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:40.686918 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] 10.222.0.22 "DELETE /v2.0/networks/670539f1-1de1-4f09-80bf-a0edd1cf2a6e HTTP/1.1" status: 204  len: 168 time: 0.9263127
Jun 01 18:52:40.794368 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.859279 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39012) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:40.905799 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-de2ac8b0-5155-4193-b2b4-fde06e76060b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=35f75df4cb564b1dad14fd0d02d3c46b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0453153
Jun 01 18:52:40.908625 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39014) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:40.962821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:40.987911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.039158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.043624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4ebddf0a-acb6-41c9-a8e7-792ac62f4cd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:41.056388 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ec7d009-a5f3-4e97-b404-46080b7ac538,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:41.059088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:41.067464 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.068637 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/9ec7d009-a5f3-4e97-b404-46080b7ac538 HTTP/1.1" status: 204  len: 168 time: 0.1591194
Jun 01 18:52:41.403159 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39026) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:41.454167 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-04a4941d-bf0d-4224-8168-0ebd3889e400 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=742cd095d98847558adeaa435437024e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0491982
Jun 01 18:52:41.456607 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39028) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:41.513446 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.540143 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.594696 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.599554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d47e4309-d5b6-4779-9150-5b94dfa60d0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:41.610428 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=540ab077-d726-47b4-9f8c-e2b384007bb4,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:41.614389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:41.617799 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:41.621640 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-bd1d8e76-1627-4c50-af8b-52eab19ef7b2 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/540ab077-d726-47b4-9f8c-e2b384007bb4 HTTP/1.1" status: 204  len: 168 time: 0.1641243
Jun 01 18:52:41.756488 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d2c262-04e9-418f-b4de-d046f6d45e31 req-5d98c9f2-9894-4eea-9841-e5fd34ddf01d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:41.757956 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-19d2c262-04e9-418f-b4de-d046f6d45e31 req-5d98c9f2-9894-4eea-9841-e5fd34ddf01d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.0818627
Jun 01 18:52:41.809331 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-19d2c262-04e9-418f-b4de-d046f6d45e31 req-fe6d87ce-94c7-4fa1-ab06-ce5b4f197e95 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452011
Jun 01 18:52:42.359139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39054) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:42.461598 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1326277738-network', 'tenant_id': '52dbd90f0982402bb02a793614e0020d'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:42.466191 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:42.470703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Usage tracker for resource:network and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:42.473598 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:42.479480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:42.489793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Made reservation on behalf of 52dbd90f0982402bb02a793614e0020d for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:52:42.492176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.503808 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.518081 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:42.521858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:42.525484 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:42.531061 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:42.614603 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.618571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.621261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ef9d87fb-c90f-4595-b056-5e2e5277cc73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:42.649100 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] vlan segment allocate from pool success with {'vlan_id': 81, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:52:42.658380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ad9614d-4a54-4842-a9a0-54b0ebcb0042,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:42.661313 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:42.665276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.665687 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Added segment 6bac363e-177f-4762-a171-bdf73801a782 of type vlan for network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27
Jun 01 18:52:42.691142 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.721051 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.722463 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:42.723176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:42.727890 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-49b50ace-88df-424f-8f20-aed6edc89103 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:42.914971 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.5547228
Jun 01 18:52:42.915863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Pushing event updated for resources: {'Network': ['ID=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:42.917746 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39062) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:42.922415 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Request body: {'subnet': {'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1326277738-subnet', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:42.925789 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:42.925937 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:52:42.929048 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:42.962281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Usage tracker for resource:subnet and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:42.969098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:42.980875 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:42.998089 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Made reservation on behalf of 52dbd90f0982402bb02a793614e0020d for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:52:43.000883 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2101686'] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.111220 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e964f194-d743-4b63-9be6-12916c597777 req-31c810ab-dcce-4ea8-ab99-da5a1ea15658 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:43.112694 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e964f194-d743-4b63-9be6-12916c597777 req-31c810ab-dcce-4ea8-ab99-da5a1ea15658 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 943 time: 0.1847718
Jun 01 18:52:43.201485 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e964f194-d743-4b63-9be6-12916c597777 req-dd898b89-82fa-4462-84de-cf031573e000 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0812371
Jun 01 18:52:43.283245 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:52:43.413843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:43.427037 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'port_id': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'mac_address': 'fa:16:3e:84:e4:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 90, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:52:43.430828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1394273', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2101636'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.435522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7cd6e895-4d2b-4682-bbbb-d68aded16473 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:43.483218 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.504293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0721dbfe-8c91-42f7-b953-19fcbeb01603 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:52:43.509782 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Pushing event updated for resources: {'Subnet': ['ID=e07cf14f-41ea-4248-9d27-d63b4df58f40,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:43.513808 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:43.518376 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:43.518873 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Network hostable DHCP agents. Network: ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:52:43.519940 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:43.524671 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.530496 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:43.541854 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:52:43.552156 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:43.562462 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:43.563278 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.569156 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b5a5073-c4d7-4ff7-b6e7-ae750790a31a None None] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:43.584120 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5e042190-8b7d-4216-abd6-bd2b26a23d1f admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.6653652
Jun 01 18:52:43.586890 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39066) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:43.591190 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:43.597608 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:43.601597 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Usage tracker for resource:router and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:43.604505 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:43.611082 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:43.621233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.622358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.637318 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.675741 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=7']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:43.679991 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:43.796225 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['0721dbfe-8c91-42f7-b953-19fcbeb01603'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:52:43.838685 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:52:43.839500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:43.913587 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.079016 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Allocated IP 172.20.0.2 (ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27/e07cf14f-41ea-4248-9d27-d63b4df58f40/2711b045-b658-4c01-b674-0abe449642e9) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:44.191603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5913e563-cf98-4338-84bd-3925abf9a02c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.226789 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.257206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.423431 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.436591 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Transition to ACTIVE for port object 2711b045-b658-4c01-b674-0abe449642e9 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:44.458099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Transition to ACTIVE for port object 2711b045-b658-4c01-b674-0abe449642e9 will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:44.464018 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.468237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:44.510988 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Allocated IP 172.27.0.89 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/adca3220-1c19-45f0-9af4-d77ccd7b7837) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:44.522690 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51eba271-e575-412b-8441-6ceabe832c9a req-9a28e67c-bb59-45cc-973c-d5a12d9ff61d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:44.524524 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-51eba271-e575-412b-8441-6ceabe832c9a req-9a28e67c-bb59-45cc-973c-d5a12d9ff61d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 944 time: 0.2140279
Jun 01 18:52:44.545414 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:44.548263 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:44.552679 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:44.554630 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Pushing event updated for resources: {'Port': ['ID=2711b045-b658-4c01-b674-0abe449642e9,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:44.558121 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:44.574914 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-51eba271-e575-412b-8441-6ceabe832c9a req-1082d375-23a9-49e6-84a2-88b70d36e956 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423851
Jun 01 18:52:44.648170 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Attempting to bind port 2711b045-b658-4c01-b674-0abe449642e9 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:44.648839 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Attempting to bind port 2711b045-b658-4c01-b674-0abe449642e9 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:44.649181 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Attempting to bind port 2711b045-b658-4c01-b674-0abe449642e9 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:44.654644 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:44.655019 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:44.655473 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.655871 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Bound using segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:44.656505 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Bound port: 2711b045-b658-4c01-b674-0abe449642e9, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:44.656885 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.673933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.703550 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.708054 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-efb32709-4c7a-429b-990c-c43d53a9417a tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:44.754411 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] For port 2711b045-b658-4c01-b674-0abe449642e9, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:44.758030 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] For port 2711b045-b658-4c01-b674-0abe449642e9, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=2711b045-b658-4c01-b674-0abe449642e9,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:44.762758 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:44.767299 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:44.770590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:44.773741 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:44.777352 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:44.810266 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Pushing event updated for resources: {'Port': ['ID=adca3220-1c19-45f0-9af4-d77ccd7b7837,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:44.816872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:44.884296 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Pushing event updated for resources: {'Port': ['ID=2711b045-b658-4c01-b674-0abe449642e9,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:44.887043 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:45.222496 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:45.295778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:45.364268 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 0721dbfe-8c91-42f7-b953-19fcbeb01603 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:45.364680 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:45.481284 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:45.509817 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:52:45.512085 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22708bcb-8597-47a1-af1b-a5d812bf9da3" -d '{"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:52:45.521184 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:45.528045 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:45.530632 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:45.558952 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:45.572925 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:52:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-528cd41d-1095-426f-abbf-57f06f22de47 x-openstack-request-id: req-528cd41d-1095-426f-abbf-57f06f22de47 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:52:45.573227 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:52:45.573488 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-528cd41d-1095-426f-abbf-57f06f22de47 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:52:45.573881 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'code': 200}
Jun 01 18:52:45.600936 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=8']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:45.604189 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:45.814695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Router a26976ef-153b-4903-83a2-c9b55440675d is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98258) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:52:45.844866 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b6d92c-6f0e-4414-a84b-3ec9b4a00cd0 req-e91b8f43-2f42-446e-b6af-c547d45326fc tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:45.846623 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-50b6d92c-6f0e-4414-a84b-3ec9b4a00cd0 req-e91b8f43-2f42-446e-b6af-c547d45326fc tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1493800
Jun 01 18:52:45.882400 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b266ab11-7f6c-48dd-b48e-3f5f83e5ebe4 None None] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:45.910958 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-50b6d92c-6f0e-4414-a84b-3ec9b4a00cd0 req-c852ec30-3f7b-450f-bb0e-d361b8115dc7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0582607
Jun 01 18:52:45.998003 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-eb4b4ab8-9074-48ef-827d-ccadf4b2b08c None None] Provisioning for port 2711b045-b658-4c01-b674-0abe449642e9 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:46.191669 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:46.194755 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee822ce0-39a2-4114-946e-1f108d665c61 req-b5be7fe9-0601-4395-86c6-83901e291a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:46.196340 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ee822ce0-39a2-4114-946e-1f108d665c61 req-b5be7fe9-0601-4395-86c6-83901e291a83 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.3025587
Jun 01 18:52:46.205270 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:46.218130 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:46.220745 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdae8d60>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:46.276989 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ee822ce0-39a2-4114-946e-1f108d665c61 req-205a30eb-8274-422d-a488-64988776927e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0686538
Jun 01 18:52:46.282697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.287025 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39084) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:46.287297 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 2.6993883
Jun 01 18:52:46.298502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 2711b045-b658-4c01-b674-0abe449642e9 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:46.485900 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 2711b045-b658-4c01-b674-0abe449642e9 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:46.496743 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:46.540610 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 2711b045-b658-4c01-b674-0abe449642e9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:46.540919 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.817055 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-169752ce-b024-4d84-8cd6-d5a99660f42b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.878845 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.896096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.929223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 2711b045-b658-4c01-b674-0abe449642e9, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=2711b045-b658-4c01-b674-0abe449642e9,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:46.934126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:46.938609 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:46.975001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.021034 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdae8d60>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:45Z', 'revision_number': 3, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:47.035099 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:47.035454 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Updating router a26976ef-153b-4903-83a2-c9b55440675d port adca3220-1c19-45f0-9af4-d77ccd7b7837 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:52:47.097259 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=2711b045-b658-4c01-b674-0abe449642e9,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:47.100404 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:47.108779 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.155993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ff1efc-0ddd-4f10-89a3-874351fe0d95 req-a14777fb-9074-4188-8a75-a11bf3b71f36 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:47.158159 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-53ff1efc-0ddd-4f10-89a3-874351fe0d95 req-a14777fb-9074-4188-8a75-a11bf3b71f36 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.1086848
Jun 01 18:52:47.204105 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-53ff1efc-0ddd-4f10-89a3-874351fe0d95 req-6729c937-2bea-4483-938a-728c1168b5d1 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398593
Jun 01 18:52:47.255389 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Allocated IP 172.20.0.1 (ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27/e07cf14f-41ea-4248-9d27-d63b4df58f40/74a3ceab-5d5d-4905-a7ae-8b84e01c61ef) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:47.401527 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.417429 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Transition to ACTIVE for port object 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:47.441576 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.445385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b698063b-f4df-4f7a-8754-e4629261a31c tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:47.483513 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.495002 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Transition to ACTIVE for port object adca3220-1c19-45f0-9af4-d77ccd7b7837 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:47.502951 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.508904 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:47.511528 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:47.514411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:47.517587 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:47.566145 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Pushing event updated for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:47.574373 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:47.581354 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Attempting to bind port adca3220-1c19-45f0-9af4-d77ccd7b7837 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:47.581730 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Attempting to bind port adca3220-1c19-45f0-9af4-d77ccd7b7837 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:47.582096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Attempting to bind port adca3220-1c19-45f0-9af4-d77ccd7b7837 on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:47.584276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.591302 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:47.591681 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:47.592085 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.592505 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:47.592981 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Bound port: adca3220-1c19-45f0-9af4-d77ccd7b7837, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:47.593353 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.621451 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b397fd-0281-4eae-9849-74b3f70cb070 None None] Pushing event updated for resources: {'Port': ['ID=adca3220-1c19-45f0-9af4-d77ccd7b7837,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:47.629865 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a4b397fd-0281-4eae-9849-74b3f70cb070 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:47.674157 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] For port adca3220-1c19-45f0-9af4-d77ccd7b7837, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:47.677546 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] For port adca3220-1c19-45f0-9af4-d77ccd7b7837, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=adca3220-1c19-45f0-9af4-d77ccd7b7837,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:47.682505 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.688089 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:47.765671 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:47.766462 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdae8d60>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:47.839566 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b397fd-0281-4eae-9849-74b3f70cb070 None None] Pushing event updated for resources: {'Port': ['ID=adca3220-1c19-45f0-9af4-d77ccd7b7837,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:47.849309 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a4b397fd-0281-4eae-9849-74b3f70cb070 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:47.874892 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.925323 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-24f6fa21-e1ce-4c67-8878-8203fbac10a3 None None] Provisioning for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:47.946503 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-24f6fa21-e1ce-4c67-8878-8203fbac10a3 None None] Provisioning complete for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:47.946882 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-24f6fa21-e1ce-4c67-8878-8203fbac10a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:47.955377 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.014673 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:48.056667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-24f6fa21-e1ce-4c67-8878-8203fbac10a3 None None] Port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:48.184527 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.189364 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.221581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fb2d0174-cbbb-45f3-978d-70f287243cc0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:48.223303 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 2711b045-b658-4c01-b674-0abe449642e9 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:48.298979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Pushing event updated for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:48.302124 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.306188 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:48.363791 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 2711b045-b658-4c01-b674-0abe449642e9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:48.364164 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.416623 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdae8d60>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:45Z', 'revision_number': 3, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:48.425398 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-242b03e8-84c1-4001-8bb1-20e59467e6d7 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:45Z', 'revision_number': 3, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:48.513113 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:48.516069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:48.528661 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9203c296-bc8b-4f89-b912-3fe2d8566ac5 req-d02a9bb2-07c5-4f21-a06d-b2ed4f0e0fae tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:48.530366 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9203c296-bc8b-4f89-b912-3fe2d8566ac5 req-d02a9bb2-07c5-4f21-a06d-b2ed4f0e0fae tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.2054679
Jun 01 18:52:48.676378 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9203c296-bc8b-4f89-b912-3fe2d8566ac5 req-7f2de0fd-20ed-4cd7-84b4-1d221f0899b8 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0939834
Jun 01 18:52:48.781967 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-549bc2b0-387e-47a6-bd1a-44afe62c71c2 None None] Provisioning complete for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:48.784355 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-549bc2b0-387e-47a6-bd1a-44afe62c71c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:48.789396 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:48.843606 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-549bc2b0-387e-47a6-bd1a-44afe62c71c2 None None] Port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:48.978568 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:48.987659 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] 10.222.0.22 "PUT /v2.0/routers/a26976ef-153b-4903-83a2-c9b55440675d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6990669
Jun 01 18:52:49.489001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39116) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:49.493927 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2135850102-network', 'tenant_id': 'c475e7accec74e35aa5db988675335f7'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:49.498859 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:49.503305 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Usage tracker for resource:network and tenant:c475e7accec74e35aa5db988675335f7 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:49.506322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:49.511622 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.513249 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:49.524416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Made reservation on behalf of c475e7accec74e35aa5db988675335f7 for: {'network': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:52:49.526694 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.538283 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.551799 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:49.555584 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Usage tracker for resource:security_group_rule and tenant:c475e7accec74e35aa5db988675335f7 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:49.558302 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:49.564292 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:49.646979 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.652016 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.656442 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8f279378-1fbd-4757-ac59-883b2ba65648 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:49.681203 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] vlan segment allocate from pool success with {'vlan_id': 79, 'physical_network': 'physnet1'}  {{(pid=98259) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:52:49.694471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18448c5e-d2b1-40d1-94cd-4262cb1bf7b8,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:49.698757 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:49.699713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.700056 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.segments_db [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Added segment 836c080f-db4c-41d0-b7f7-5f5e5accb310 of type vlan for network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c
Jun 01 18:52:49.726714 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.757503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.759732 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:49.760687 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.777683 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8811651e-38cf-458c-8b2f-eaed24742664 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:49.822990 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.3328910
Jun 01 18:52:49.825975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39120) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:49.832175 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Request body: {'subnet': {'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2135850102-subnet', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'ip_version': 4}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:49.837785 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:49.841624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Usage tracker for resource:subnet and tenant:c475e7accec74e35aa5db988675335f7 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:49.844394 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:49.850214 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:49.861047 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Made reservation on behalf of c475e7accec74e35aa5db988675335f7 for: {'subnet': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:52:49.863430 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2101686'] for subnet, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:49.873861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Pushing event updated for resources: {'Network': ['ID=8dd511ae-bf28-4636-8cd2-85c0262c3d2c,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:49.877210 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:49.884720 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:52:50.003932 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:50.013838 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:50.014440 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd950d60>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:50.191317 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:50.242535 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device adca3220-1c19-45f0-9af4-d77ccd7b7837 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:50.270156 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1394273', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2101636'] for subnet, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.274889 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:50.320330 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port adca3220-1c19-45f0-9af4-d77ccd7b7837 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:50.325820 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port adca3220-1c19-45f0-9af4-d77ccd7b7837 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:50.326598 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.330365 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=722f743e-d63c-4f10-98d2-3f241dd732a9,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:50.358419 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:50.396400 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Checking segment: {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:50.396822 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Network hostable DHCP agents. Network: 8dd511ae-bf28-4636-8cd2-85c0262c3d2c, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98258) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:52:50.419125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98258) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:52:50.435133 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 8dd511ae-bf28-4636-8cd2-85c0262c3d2c) {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:50.449666 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e232a7aa-f0c3-4beb-b914-62aff42db8ff None None] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:50.456821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:52:50.457238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.498664 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39124) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:50.499236 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d8812dbf-8b43-4fcd-8889-428cd882c5ee admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.6713078
Jun 01 18:52:50.504389 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:50.517812 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:50.524367 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Usage tracker for resource:router and tenant:c475e7accec74e35aa5db988675335f7 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:50.528397 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:50.537393 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:50.551912 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-2041788', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14962'] for router, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.553409 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2041681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1617251', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1644943', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14917'] for router, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.560902 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.575242 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.579238 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd950d60>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:48Z', 'revision_number': 2, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:50.584675 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:50.585204 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Updating router a26976ef-153b-4903-83a2-c9b55440675d port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:52:50.638778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port adca3220-1c19-45f0-9af4-d77ccd7b7837, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=adca3220-1c19-45f0-9af4-d77ccd7b7837,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:50.653946 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.657280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.664603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:50.827391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=adca3220-1c19-45f0-9af4-d77ccd7b7837,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:50.836514 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:50.838582 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6911a09f-866d-5549-b5a4-9f8eb50784d3-8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9'}]}} from dv-cinder-794021-1-iscsi. {{(pid=98260) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 18:52:50.839417 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:50.990027 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1617277', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2041806', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14935'] for router, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.004090 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.db_base_plugin_common [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Allocated IP 172.20.0.2 (8dd511ae-bf28-4636-8cd2-85c0262c3d2c/722f743e-d63c-4f10-98d2-3f241dd732a9/85c283ff-38a4-426c-894b-2f2880e61d95) {{(pid=98260) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:51.091803 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.105609 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Transition to ACTIVE for port object 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:51.112687 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.117402 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-7ce013b5-349e-4e67-a9d2-01783ca111d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:51.217963 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks [] for port, precommit_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.231740 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Transition to ACTIVE for port object 85c283ff-38a4-426c-894b-2f2880e61d95 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:51.256369 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Transition to ACTIVE for port object 85c283ff-38a4-426c-894b-2f2880e61d95 will not be triggered until provisioned by entity DHCP. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:51.266199 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865'] for port, after_create {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.270300 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-a4b397fd-0281-4eae-9849-74b3f70cb070 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:51.275845 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Pushing event updated for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:51.318844 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.319209 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.320020 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.320020 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.320204 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.320509 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.320777 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.321094 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.321424 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.321743 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.322055 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.322362 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98261) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:52:51.332699 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:51.350741 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c is already hosted by enough agents. {{(pid=98260) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:51.351597 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Pushing event updated for resources: {'Port': ['ID=85c283ff-38a4-426c-894b-2f2880e61d95,revision_number=1']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:51.352511 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.354201 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.scheduler.base_scheduler [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Resources bound (agent type, host, resource id):  {{(pid=98260) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:51.355848 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:51.356585 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Received port after_create {{(pid=98260) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:51.361163 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Attempting to bind port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:51.361529 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Attempting to bind port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:51.361884 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Attempting to bind port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:51.367626 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:51.367995 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:51.368456 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.368785 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Bound using segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:51.369246 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Bound port: 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:51.369610 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.396646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.451324 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Attempting to bind port 85c283ff-38a4-426c-894b-2f2880e61d95 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:51.451694 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Attempting to bind port 85c283ff-38a4-426c-894b-2f2880e61d95 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:51.452058 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Attempting to bind port 85c283ff-38a4-426c-894b-2f2880e61d95 on network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:51.459570 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:51.459750 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Checking segment: {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:51.460179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.460702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Bound using segment: {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:51.461195 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Bound port: 85c283ff-38a4-426c-894b-2f2880e61d95, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:51.461610 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.462659 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] For port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:51.466235 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] For port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:51.471290 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.478010 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:51.558963 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] For port 85c283ff-38a4-426c-894b-2f2880e61d95, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:51.560142 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:51.560941 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd950d60>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:51.563335 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] For port 85c283ff-38a4-426c-894b-2f2880e61d95, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=85c283ff-38a4-426c-894b-2f2880e61d95,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:51.570633 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.571740 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Allocated IP 172.27.0.104 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/7bc20b13-4eab-4d52-8b6f-71b0a631c9d9) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:51.574926 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-9b3052c3-fbd1-409f-80eb-6d1cdb5b6982 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:51.670996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Pushing event updated for resources: {'Port': ['ID=85c283ff-38a4-426c-894b-2f2880e61d95,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:51.676254 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:51.764864 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:51.767692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.808601 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:51.813749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-e6214c1b-5891-4700-96a5-74a95b006263 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:51.877208 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:51.881163 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:51.898635 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:51.955774 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Pushing event updated for resources: {'Port': ['ID=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:51.965247 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:52.048997 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Pushing event updated for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=4']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:52.053551 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-fbcf68ec-19bb-4f94-b5cb-5239cd25b61b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.576s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:52.143097 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd950d60>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:51Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:52.146123 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-304963a1-2a45-4b58-a5eb-6c46b771c9d0 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:51Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:52.349025 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device adca3220-1c19-45f0-9af4-d77ccd7b7837 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:52.387409 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:52.438504 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port adca3220-1c19-45f0-9af4-d77ccd7b7837 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:52.438949 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:52.600754 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 85c283ff-38a4-426c-894b-2f2880e61d95 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:52.698056 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 85c283ff-38a4-426c-894b-2f2880e61d95 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:52.784862 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43388833-daed-4a1a-acae-9dbafb743006 None None] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:52:52.880333 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Provisioning for port 85c283ff-38a4-426c-894b-2f2880e61d95 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:52.890605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Provisioning complete for port 85c283ff-38a4-426c-894b-2f2880e61d95 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:52.890979 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:52.916635 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2041797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1617296'] for router, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:53.139922 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Router a0288693-400a-40e4-ba75-80b31d2b44a2 is scheduled to L3 agent a781c47f-234c-4b81-beaa-1c11a964613c with binding_index 1 {{(pid=98259) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 18:52:53.179121 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:53.219971 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] For port 85c283ff-38a4-426c-894b-2f2880e61d95, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=85c283ff-38a4-426c-894b-2f2880e61d95,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:53.228176 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:53.230583 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:53.311528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Pushing event updated for resources: {'Port': ['ID=85c283ff-38a4-426c-894b-2f2880e61d95,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:53.314811 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:53.342820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:53.352799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Sync routers for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:53.362991 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:53.363769 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b100>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:53.368025 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:53.371839 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-1833040e-5d7e-4b26-87aa-efaec6d47fc8 admin admin] 10.222.0.22 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 2.8683434
Jun 01 18:52:53.371987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39136) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:53.548507 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:53.687394 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7edb59bf-fbbb-4afd-a7ad-01dfd6dec58e None None] Provisioning complete for port 85c283ff-38a4-426c-894b-2f2880e61d95 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:53.687768 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7edb59bf-fbbb-4afd-a7ad-01dfd6dec58e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:53.949330 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b100>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:52Z', 'revision_number': 3, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:53.953425 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Checking router: a0288693-400a-40e4-ba75-80b31d2b44a2 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:52:53.953778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Updating router a0288693-400a-40e4-ba75-80b31d2b44a2 port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 binding host dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:52:54.006927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.146785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.331791 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 85c283ff-38a4-426c-894b-2f2880e61d95 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:54.385863 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Allocated IP 172.20.0.1 (8dd511ae-bf28-4636-8cd2-85c0262c3d2c/722f743e-d63c-4f10-98d2-3f241dd732a9/d9cd041c-0b7f-4f38-9724-e313d6652e1f) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:52:54.415633 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks [] for port, precommit_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.429891 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Transition to ACTIVE for port object 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 will not be triggered until provisioned by entity L2. {{(pid=98260) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:54.440739 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.444501 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-64b56b0e-ba11-402c-830f-b57355dcc7e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:54.474620 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 85c283ff-38a4-426c-894b-2f2880e61d95 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:54.474993 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.537593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.552937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Transition to ACTIVE for port object d9cd041c-0b7f-4f38-9724-e313d6652e1f will not be triggered until provisioned by entity DHCP. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:52:54.576351 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.581617 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2b354b11-7778-458f-b2fd-e62ebe2ef091 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:54.584246 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Attempting to bind port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:52:54.584653 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Attempting to bind port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:52:54.585028 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Attempting to bind port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 on network 51c15cd0-3fb9-458f-96e0-aa926a3585bf {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:52:54.588697 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Pushing event updated for resources: {'Port': ['ID=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,revision_number=2']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:54.595665 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:54.596579 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:52:54.596962 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Checking segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98260) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:52:54.597364 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.597756 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Bound using segment: {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'} {{(pid=98260) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:52:54.598226 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.managers [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Bound port: 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cb30134-8767-4a68-8c75-632abd865f06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf'}}] {{(pid=98260) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:52:54.598603 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.645624 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:54.649039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:54.652720 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:52:54.699486 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Pushing event updated for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:54.702357 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:54.720920 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1616986'] for router_interface, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.725047 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:54.760892 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] For port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98260) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:52:54.786727 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] For port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:52:54.795134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.802712 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-577eeb5d-f9ba-4223-bc0b-5c59d37cac01 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:54.863723 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:54.917144 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:54.917730 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b100>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:54.994073 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:55.014935 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:55.015959 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.038956 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Pushing event updated for resources: {'Port': ['ID=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,revision_number=3']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:55.055306 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:55.070925 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-97962e9c-908c-4acc-9e54-aea04e3db59e None None] Provisioning for port d9cd041c-0b7f-4f38-9724-e313d6652e1f completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:55.092447 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.096865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.126030 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-816e0c82-a7b5-41f5-b82f-69068c33932e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:55.138174 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-97962e9c-908c-4acc-9e54-aea04e3db59e None None] Provisioning complete for port d9cd041c-0b7f-4f38-9724-e313d6652e1f triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:55.138549 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-97962e9c-908c-4acc-9e54-aea04e3db59e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.202500 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Pushing event updated for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:55.205246 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:55.208675 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1617093'] for router_interface, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.224782 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-97962e9c-908c-4acc-9e54-aea04e3db59e None None] Port d9cd041c-0b7f-4f38-9724-e313d6652e1f cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:55.229972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:52:55.342297 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:52:55.343648 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:52:55.405707 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.528740 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:55.541168 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.544367 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Router a0288693-400a-40e4-ba75-80b31d2b44a2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:52:55.545938 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:55.673977 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:55.677190 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:55.682687 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-94b71958-2868-4bfd-a2f6-62c0b81c8039 None None] Provisioning complete for port d9cd041c-0b7f-4f38-9724-e313d6652e1f triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:55.683104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-94b71958-2868-4bfd-a2f6-62c0b81c8039 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:55.746375 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-94b71958-2868-4bfd-a2f6-62c0b81c8039 None None] Port d9cd041c-0b7f-4f38-9724-e313d6652e1f cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:52:55.756639 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd81b100>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'd9cd041c-0b7f-4f38-9724-e313d6652e1f', 'name': '', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'mac_address': 'fa:16:3e:d7:f5:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:54Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 1, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'subnets': [{'id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:55.760536 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c720d744-7008-4efa-9f4f-2570181899bb None None] The sync data for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi is: [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'd9cd041c-0b7f-4f38-9724-e313d6652e1f', 'name': '', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'mac_address': 'fa:16:3e:d7:f5:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:54Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 1, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'subnets': [{'id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:52:55.828404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:52:55.837243 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] 10.222.0.22 "PUT /v2.0/routers/a0288693-400a-40e4-ba75-80b31d2b44a2/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4642835
Jun 01 18:52:56.223623 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:56.312418 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:56.313043 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.358976 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39158) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:56.364322 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2096723707', 'description': 'tempest-secgroup-smoke-2096723707 description', 'project_id': '52dbd90f0982402bb02a793614e0020d'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:56.370351 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:56.375336 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:56.378749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:56.385169 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:56.409251 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.432143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:56.436293 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:56.439354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:56.445563 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:56.569433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.577475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.584272 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:56.632410 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroup': ['ID=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:56.635567 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:56.636986 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.638193 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7dd9b100-5440-4404-906c-e63f83270285 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.2776642
Jun 01 18:52:56.641255 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39162) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:56.646975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:56.657432 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:56.661912 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:56.665711 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:56.685705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:56.716973 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.800877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.812836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.815365 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:56.832527 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b2d0176b-dd96-4c34-99a8-5f82812d7ec0,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:56.839434 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:56.852383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.853770 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-f34b9a92-42fc-411c-8cfb-86e5f8570d88 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2107775
Jun 01 18:52:56.856622 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39168) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:56.861913 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:56.867993 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:56.871883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:56.875369 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:56.881350 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:56.899307 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.965382 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.969961 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:56.976346 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0f735d2c-1394-4779-96e6-a70bed718c36 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:56.995591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1229c186-ef1c-4410-879d-7394942cc22e,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:56.998686 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:57.007213 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.008582 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2828ee6a-6bb2-4ad3-aecb-1c4c444e2287 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1507657
Jun 01 18:52:57.011403 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39170) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:57.016059 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:57.022133 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:57.026337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:57.029764 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:57.036026 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:57.056320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.121575 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.125841 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.127886 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-47b24b72-2be6-4993-9cd6-284019ca1d75 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:57.150561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d68f932-c62a-4f34-9399-a131f47a4b9f,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:57.154205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:57.161917 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.163183 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-96ca433e-c3d5-4b7d-8668-9df1337baba8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1507673
Jun 01 18:52:57.165990 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39172) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:57.170660 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:57.176678 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:57.180814 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:57.183729 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:57.189997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:57.206122 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.268499 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.271689 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.273981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d1e7da83-9540-4f51-928a-8d8e57081f3f tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:57.295045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=45805713-968d-4b6e-bd07-f371d577eb43,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:57.297586 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:57.304557 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.305875 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a8bab61a-da18-4822-89e7-64feb48d84b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1388412
Jun 01 18:52:57.308533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39174) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:57.313760 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:57.319466 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:57.323225 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:57.326136 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:57.332626 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:57.341931 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.securitygroups_db [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Project 52dbd90f0982402bb02a793614e0020d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:52:57.347447 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.412788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.416210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.422337 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:57.442000 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23d54ebf-57b2-416d-990f-090944830b13,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:57.444784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:57.451688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.455372 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3d91cb52-2038-41ba-a2f3-f71cd3d4f97d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1433537
Jun 01 18:52:57.455557 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39176) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:52:57.459895 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'security_group_rule': {'security_group_id': '79b7f04f-c3ff-42d0-82b2-2e6dd86603f0', 'project_id': '52dbd90f0982402bb02a793614e0020d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:52:57.465357 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:52:57.469074 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:security_group_rule and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:52:57.471855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:52:57.477457 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:52:57.490374 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.securitygroups_db [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Project 52dbd90f0982402bb02a793614e0020d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 18:52:57.495757 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.560355 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.564085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640573'] for security_group_rule, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.571206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ce137eb4-0f46-44ba-b358-fae5399f6a1d tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:57.590777 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dc96afba-92da-4686-9751-99e0a4277e47,revision_number=0']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:57.592925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:57.597337 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:57.598481 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a1828ff2-193d-49e9-b429-0a441e0d707a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1420226
Jun 01 18:52:58.285592 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:52:58.365181 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:52:58.372181 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:52:58.372662 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:58.519429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:58.536331 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:52:58.541107 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:52:58.543111 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:52:58.610484 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:52:58.614487 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:52:59.699299 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Sync routers for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:52:59.709203 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:52:59.709810 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf32250>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:52:59.887423 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:00.228048 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:00.233975 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf32250>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'd9cd041c-0b7f-4f38-9724-e313d6652e1f', 'name': '', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'mac_address': 'fa:16:3e:d7:f5:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:54Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 2, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'subnets': [{'id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:00.237797 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Checking router: a0288693-400a-40e4-ba75-80b31d2b44a2 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:53:00.238259 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Updating router a0288693-400a-40e4-ba75-80b31d2b44a2 port d9cd041c-0b7f-4f38-9724-e313d6652e1f binding host dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 18:53:00.299508 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:00.299843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:00.300286 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:00.682353 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks [] for port, precommit_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:00.694234 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.provisioning_blocks [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Transition to ACTIVE for port object d9cd041c-0b7f-4f38-9724-e313d6652e1f will not be triggered until provisioned by entity L2. {{(pid=98261) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:53:00.700625 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:00.704218 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:00.873562 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c975c4-4b9d-44fe-8d64-2302089bf44b None None] Pushing event updated for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=3']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:00.876505 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a1c975c4-4b9d-44fe-8d64-2302089bf44b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:00.934979 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Attempting to bind port d9cd041c-0b7f-4f38-9724-e313d6652e1f on host dv-cinder-794021-1-iscsi for vnic_type normal with profile  {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:53:00.935357 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Attempting to bind port d9cd041c-0b7f-4f38-9724-e313d6652e1f by drivers openvswitch,hyperv on host dv-cinder-794021-1-iscsi at level 0 using segments [{'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:53:00.935723 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Attempting to bind port d9cd041c-0b7f-4f38-9724-e313d6652e1f on network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:53:00.940835 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Checking agent: {'id': 'c6ff7391-98d0-439a-9e8c-7a25c6c584ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 39, 47), 'started_at': datetime.datetime(2021, 6, 1, 18, 40, 17), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 52, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:53:00.941213 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Checking segment: {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98261) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:53:00.941617 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:00.942013 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Bound using segment: {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'} {{(pid=98261) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:53:00.942559 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.managers [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Bound port: d9cd041c-0b7f-4f38-9724-e313d6652e1f, host: dv-cinder-794021-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '836c080f-db4c-41d0-b7f7-5f5e5accb310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 79, 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c'}}] {{(pid=98261) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:53:00.942935 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:01.036863 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] For port d9cd041c-0b7f-4f38-9724-e313d6652e1f, host dv-cinder-794021-1-iscsi, cleared binding levels {{(pid=98261) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:53:01.039733 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.plugins.ml2.db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] For port d9cd041c-0b7f-4f38-9724-e313d6652e1f, host dv-cinder-794021-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d9cd041c-0b7f-4f38-9724-e313d6652e1f,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98261) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:53:01.044143 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron_lib.callbacks.manager [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:01.048667 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-c43c3684-f36a-4055-a413-b4cea4832a23 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:01.119086 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:01.119713 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf32250>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:52:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:01.194006 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c975c4-4b9d-44fe-8d64-2302089bf44b None None] Pushing event updated for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=4']} {{(pid=98261) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:01.197755 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG oslo_concurrency.lockutils [None req-a1c975c4-4b9d-44fe-8d64-2302089bf44b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:01.314607 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:01.683997 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf32250>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'd9cd041c-0b7f-4f38-9724-e313d6652e1f', 'name': '', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'mac_address': 'fa:16:3e:d7:f5:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:54Z', 'updated_at': '2021-06-01T18:53:01Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'subnets': [{'id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:01.692466 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-408a6ef0-8a3c-43fb-9dfc-830a18f2b69f None None] The sync data for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi is: [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T18:52:54Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': 'd9cd041c-0b7f-4f38-9724-e313d6652e1f', 'name': '', 'network_id': '8dd511ae-bf28-4636-8cd2-85c0262c3d2c', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'mac_address': 'fa:16:3e:d7:f5:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:54Z', 'updated_at': '2021-06-01T18:53:01Z', 'revision_number': 4, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'subnets': [{'id': '722f743e-d63c-4f10-98d2-3f241dd732a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:53:02.229246 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d9cd041c-0b7f-4f38-9724-e313d6652e1f up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:02.295098 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning for port d9cd041c-0b7f-4f38-9724-e313d6652e1f completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:53:02.300068 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port d9cd041c-0b7f-4f38-9724-e313d6652e1f triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:02.300470 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:02.414844 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:02.448550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] For port d9cd041c-0b7f-4f38-9724-e313d6652e1f, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d9cd041c-0b7f-4f38-9724-e313d6652e1f,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:02.452537 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:02.454322 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:02.520813 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Pushing event updated for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:02.523992 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:03.103029 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17955b1c-bb9c-4b41-86d0-1e0373162ec4 req-aa6c1904-b37f-4e22-aa08-cf2685be1021 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:03.104717 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-17955b1c-bb9c-4b41-86d0-1e0373162ec4 req-aa6c1904-b37f-4e22-aa08-cf2685be1021 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0853038
Jun 01 18:53:03.155285 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-17955b1c-bb9c-4b41-86d0-1e0373162ec4 req-bb2f1d9f-dbb0-407e-a095-b5112a8597d7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445983
Jun 01 18:53:04.211856 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d9cd041c-0b7f-4f38-9724-e313d6652e1f up at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:04.285881 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Provisioning complete for port d9cd041c-0b7f-4f38-9724-e313d6652e1f triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:04.286267 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:04.358130 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abc5852-e49a-4e81-a55f-b7dd7b9d2f65 req-8c32a3ed-6b45-4226-ad3b-c4df3d60c1eb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:04.359634 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0abc5852-e49a-4e81-a55f-b7dd7b9d2f65 req-8c32a3ed-6b45-4226-ad3b-c4df3d60c1eb tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0808501
Jun 01 18:53:04.404621 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0abc5852-e49a-4e81-a55f-b7dd7b9d2f65 req-2ea80a0d-97bb-4b45-9bca-565bffee783a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392845
Jun 01 18:53:05.620810 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c1702f-50c9-4128-a8b3-dc97a43edad4 req-c125ae17-3d95-46dd-8040-90c36e97d407 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:05.624700 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-69c1702f-50c9-4128-a8b3-dc97a43edad4 req-c125ae17-3d95-46dd-8040-90c36e97d407 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.1046760
Jun 01 18:53:05.668991 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-69c1702f-50c9-4128-a8b3-dc97a43edad4 req-e781139f-2ee6-4f42-8d5d-d7cbd7c23a38 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410593
Jun 01 18:53:06.871937 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b1b774-5212-4d4a-871d-5844e8fe6111 req-07f3007a-d4dd-4565-bf48-cf6ee3b5d9c5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:06.873409 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a1b1b774-5212-4d4a-871d-5844e8fe6111 req-07f3007a-d4dd-4565-bf48-cf6ee3b5d9c5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0867593
Jun 01 18:53:06.919510 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a1b1b774-5212-4d4a-871d-5844e8fe6111 req-53edd734-e951-4595-b8ae-da6b8877ad09 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403700
Jun 01 18:53:08.114549 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9647723b-44e8-45a0-a03e-7012f28179b4 req-2b06dffa-daf3-431b-9883-5ee5f740ab95 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:08.115998 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9647723b-44e8-45a0-a03e-7012f28179b4 req-2b06dffa-daf3-431b-9883-5ee5f740ab95 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0801151
Jun 01 18:53:08.164912 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9647723b-44e8-45a0-a03e-7012f28179b4 req-939720d8-d45d-411b-94d6-4e3de4b4f450 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0431998
Jun 01 18:53:09.223406 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:53:09.355004 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab62222-ac6c-4a37-b603-1cd95f7c7d7c req-3ac325af-6f76-4e7b-8b21-cae324f54332 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:09.356495 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ab62222-ac6c-4a37-b603-1cd95f7c7d7c req-3ac325af-6f76-4e7b-8b21-cae324f54332 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0794218
Jun 01 18:53:09.404904 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ab62222-ac6c-4a37-b603-1cd95f7c7d7c req-28a75e0a-f5f1-4a31-ab16-e2a8b5a44c12 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423090
Jun 01 18:53:10.598677 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844991e3-032c-4e29-8b3c-261c46fa3d1a req-95834e92-70d3-45c4-bd05-5b84e19a6ca6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:10.600138 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-844991e3-032c-4e29-8b3c-261c46fa3d1a req-95834e92-70d3-45c4-bd05-5b84e19a6ca6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0845864
Jun 01 18:53:10.645305 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-844991e3-032c-4e29-8b3c-261c46fa3d1a req-959dbbe5-8554-4a92-8991-2e968d8b855b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386662
Jun 01 18:53:10.783579 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:11.835981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcb9ddb-dd3a-45b7-a18e-bb7b7775010d req-c0b60599-caf4-4176-a0f9-fd64cc2e841a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:11.837456 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-abcb9ddb-dd3a-45b7-a18e-bb7b7775010d req-c0b60599-caf4-4176-a0f9-fd64cc2e841a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0791578
Jun 01 18:53:11.880888 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-abcb9ddb-dd3a-45b7-a18e-bb7b7775010d req-be62ee5b-d8ad-4148-b3d9-910591de7cbe tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377712
Jun 01 18:53:13.070542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d76765-b5eb-4644-bf84-aa608c8a8b87 req-ff065b26-ee6e-492e-8d74-32d8d4ce4de2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:13.071924 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b5d76765-b5eb-4644-bf84-aa608c8a8b87 req-ff065b26-ee6e-492e-8d74-32d8d4ce4de2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0835915
Jun 01 18:53:13.115449 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b5d76765-b5eb-4644-bf84-aa608c8a8b87 req-d072391b-a3ed-4443-9856-8ccc584b994f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379803
Jun 01 18:53:14.133500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3d40255a-9732-4e59-986c-2e30b42690a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:14.324770 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc21ce41-6ce5-410a-bc3a-2a4b88e32ecd req-9b40426f-70e9-4f54-a237-e6ab45b85837 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:14.326214 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cc21ce41-6ce5-410a-bc3a-2a4b88e32ecd req-9b40426f-70e9-4f54-a237-e6ab45b85837 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0850461
Jun 01 18:53:14.370469 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cc21ce41-6ce5-410a-bc3a-2a4b88e32ecd req-612fd249-0925-44f2-993e-7395e892d474 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381978
Jun 01 18:53:14.991034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-f931ab3a-370e-4769-8d9e-9831bebbcd4a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:security_group {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:53:15.009475 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-f931ab3a-370e-4769-8d9e-9831bebbcd4a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:security_group {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:53:15.010697 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-f931ab3a-370e-4769-8d9e-9831bebbcd4a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2096723707&fields=id&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 267 time: 0.0583291
Jun 01 18:53:15.161295 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-510556a1-ae3a-4909-a691-fa782d7269d5 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:15.162621 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-510556a1-ae3a-4909-a691-fa782d7269d5 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.1454439
Jun 01 18:53:15.176719 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-ddc06ff9-6478-42f6-92f7-3fcffe914912 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/quotas/52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 375 time: 0.0086646
Jun 01 18:53:15.257357 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-83473fd5-0816-4d41-9f44-c39bbf3947f8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:53:15.278332 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-83473fd5-0816-4d41-9f44-c39bbf3947f8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:53:15.279604 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-83473fd5-0816-4d41-9f44-c39bbf3947f8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0982685
Jun 01 18:53:15.412365 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:53:15.516049 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-ae450bf7-4606-4b13-9b7d-d7f2727a4048 service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2251365
Jun 01 18:53:15.551780 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:15.561359 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e179dc7c-f35d-4905-a446-237ba8b49da0 req-64ee125b-7b89-4009-a020-15c9d7885002 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:15.562844 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e179dc7c-f35d-4905-a446-237ba8b49da0 req-64ee125b-7b89-4009-a020-15c9d7885002 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0817850
Jun 01 18:53:15.566907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '1151ad48-db08-470c-a31f-319eab029862', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:53:15.608473 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e179dc7c-f35d-4905-a446-237ba8b49da0 req-ad4e9b2f-2325-424d-932b-17a2267da32a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390182
Jun 01 18:53:15.621974 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:15.639484 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:53:15.652198 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-b7d63c48-58e5-4ab4-a3ae-9d52dd7340ec service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1300790
Jun 01 18:53:15.654747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:15.659468 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:15.662406 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:15.734233 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=6']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.745293 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.746171 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.746171 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:15.749682 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:15.772793 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['1151ad48-db08-470c-a31f-319eab029862'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:53:16.130383 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5a55c1f5-409a-408f-b40b-1bce2acd52a9 req-127d4dca-eb40-402b-b324-3c26f78bb8c3 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 210 time: 0.1340680
Jun 01 18:53:16.721792 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1d49d526-a119-4aa9-aaa0-ea9a4ea9967b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:16.825999 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a8f973-9701-49d0-b749-d1cb0f2c8763 req-b402fe1f-e25f-43f0-ad86-72a9e57d8107 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:16.827474 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-33a8f973-9701-49d0-b749-d1cb0f2c8763 req-b402fe1f-e25f-43f0-ad86-72a9e57d8107 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0897276
Jun 01 18:53:16.860314 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:16.879870 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-33a8f973-9701-49d0-b749-d1cb0f2c8763 req-fe2c3610-abe3-4784-9ec8-636430f8d711 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0463636
Jun 01 18:53:17.181558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-76baa5bf-c714-4db9-8d03-61f4c8d36b7b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:17.182360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-76baa5bf-c714-4db9-8d03-61f4c8d36b7b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:network {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:53:17.213886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-76baa5bf-c714-4db9-8d03-61f4c8d36b7b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:network {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:53:17.215063 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-76baa5bf-c714-4db9-8d03-61f4c8d36b7b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.2101424
Jun 01 18:53:17.282866 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-0b63b599-ff5a-4dd6-bb74-242d9cd90e66 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:53:17.331394 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-0b63b599-ff5a-4dd6-bb74-242d9cd90e66 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:53:17.332574 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-0b63b599-ff5a-4dd6-bb74-242d9cd90e66 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 380 time: 0.1079230
Jun 01 18:53:17.346834 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-533e737c-f037-4603-ba77-753bf56918af req-d2a2c041-75bd-4b83-993a-59934d9af03c tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 210 time: 0.0698814
Jun 01 18:53:17.356171 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'port': {'device_id': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'admin_state_up': True, 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'security_groups': ['79b7f04f-c3ff-42d0-82b2-2e6dd86603f0']}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:53:17.453534 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:17.496030 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:53:17.506309 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:53:17.517367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Made reservation on behalf of 52dbd90f0982402bb02a793614e0020d for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:53:17.521691 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:17.535614 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 1151ad48-db08-470c-a31f-319eab029862 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:17.536406 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:17.687991 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:17.712936 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.20.0.11 (ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27/e07cf14f-41ea-4248-9d27-d63b4df58f40/ae69b620-8054-4500-b3ca-90716cc72e67) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:53:17.717734 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:17.719983 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1a1c210-5caa-40e3-8dac-e95d23e55ace" -d '{"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:17.734964 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:17.744069 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:17.750507 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:17.837517 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:17.852502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=7']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:17.857279 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:17.873693 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6814bba-3140-45af-9f46-1adaf2fc5f8f x-openstack-request-id: req-e6814bba-3140-45af-9f46-1adaf2fc5f8f {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:17.874027 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:17.874338 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e6814bba-3140-45af-9f46-1adaf2fc5f8f {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:17.874793 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'code': 200}
Jun 01 18:53:18.002460 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:18.022153 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Transition to ACTIVE for port object ae69b620-8054-4500-b3ca-90716cc72e67 will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:53:18.145281 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:18.161219 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5f2ecede-6f7a-48d5-b33c-74413bac0828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:18.215956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:53:18.216667 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:53:18.244853 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:53:18.278844 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92eb3757-8db8-436b-8cf2-35f4176e4cac req-b386dbe0-cd52-417b-b6fd-3cc13d8d47a2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:18.280826 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-92eb3757-8db8-436b-8cf2-35f4176e4cac req-b386dbe0-cd52-417b-b6fd-3cc13d8d47a2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.2337713
Jun 01 18:53:18.320867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:18.334802 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.335475 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.336014 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.336566 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.337098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.337634 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.337995 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.338358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.338720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.339075 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.339440 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.339792 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:18.349181 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:18.396582 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-92eb3757-8db8-436b-8cf2-35f4176e4cac req-43bbc9d0-5b3b-481a-854f-aaaa2d2e1da9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1047268
Jun 01 18:53:18.402768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:18.403390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:18.443821 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0955646
Jun 01 18:53:18.456744 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Request body: {'port': {'device_id': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:53:18.558257 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-e9b799a4-e805-442d-a550-77955fb8e663 None None] Provisioning for port ae69b620-8054-4500-b3ca-90716cc72e67 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:53:18.564314 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-e9b799a4-e805-442d-a550-77955fb8e663 None None] Provisioning complete for port ae69b620-8054-4500-b3ca-90716cc72e67 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:18.564994 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e9b799a4-e805-442d-a550-77955fb8e663 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:18.599758 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2203220-f670-4022-a4e9-3b80596167ae req-2c26ae6e-854d-4f0c-a7f4-b2c17bb282fe tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:18.601986 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c2203220-f670-4022-a4e9-3b80596167ae req-2c26ae6e-854d-4f0c-a7f4-b2c17bb282fe tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 932 time: 0.1290956
Jun 01 18:53:18.654525 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:18.660546 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c2203220-f670-4022-a4e9-3b80596167ae req-50ce1dae-6e05-4386-aa59-d14dc191be53 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0511496
Jun 01 18:53:18.678277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-e9b799a4-e805-442d-a550-77955fb8e663 None None] Port ae69b620-8054-4500-b3ca-90716cc72e67 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:53:19.031347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ae69b620-8054-4500-b3ca-90716cc72e67 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:53:19.039518 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.053848 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Transition to ACTIVE for port object ae69b620-8054-4500-b3ca-90716cc72e67 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:53:19.058747 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.063193 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c817820b-0b5a-4436-8025-48c39cb962af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:19.225745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Pushing event updated for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:19.329989 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:19.409653 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Attempting to bind port ae69b620-8054-4500-b3ca-90716cc72e67 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:53:19.410018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Attempting to bind port ae69b620-8054-4500-b3ca-90716cc72e67 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:53:19.410347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Attempting to bind port ae69b620-8054-4500-b3ca-90716cc72e67 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:53:19.415135 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Port ae69b620-8054-4500-b3ca-90716cc72e67 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:53:19.415454 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Attempting to bind port ae69b620-8054-4500-b3ca-90716cc72e67 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:53:19.420931 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 53, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:53:19.421264 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:53:19.421638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Bound using segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:53:19.422085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Bound port: ae69b620-8054-4500-b3ca-90716cc72e67, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:53:19.422410 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.526155 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.593477 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:53:19.604713 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ae69b620-8054-4500-b3ca-90716cc72e67,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:53:19.615124 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.620569 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1e529d1a-a713-4960-94d5-b118603b0faa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:19.702688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:19.706081 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:19.710758 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] 10.222.0.25 "PUT /v2.0/ports/ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 200  len: 1094 time: 1.2592378
Jun 01 18:53:19.711307 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:19.713655 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae21be03-7ccb-43fb-842f-7280a2afbafe" -d '{"events": [{"name": "network-changed", "server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:19.828417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d2c1e3-a525-4ca5-85f2-5eb284edea45 req-3bd90ab0-8620-49d8-83a3-fc5ea7f49681 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:19.836617 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c1d2c1e3-a525-4ca5-85f2-5eb284edea45 req-3bd90ab0-8620-49d8-83a3-fc5ea7f49681 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.3012753
Jun 01 18:53:19.892109 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Pushing event updated for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:19.901961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:19.910548 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-362f0fc3-04af-4302-a036-e80667bfd434 req-b33f3b28-ede1-4159-8878-3e642579323e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:19.917535 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-362f0fc3-04af-4302-a036-e80667bfd434 req-b33f3b28-ede1-4159-8878-3e642579323e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.1000745
Jun 01 18:53:19.933560 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c1d2c1e3-a525-4ca5-85f2-5eb284edea45 req-595e23d7-63ed-43d1-90a5-d18c12b023f0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0959487
Jun 01 18:53:19.941685 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-55193a67-65b0-447b-a934-a7f9f4e45809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:19.943227 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-55193a67-65b0-447b-a934-a7f9f4e45809 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1097 time: 0.1741524
Jun 01 18:53:20.003994 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-362f0fc3-04af-4302-a036-e80667bfd434 req-c9b89b3f-2310-4ac4-9886-433268c0175d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0846033
Jun 01 18:53:20.042479 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-fe707784-0e57-4bc2-a9ad-b0f8d52b38f8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 200  len: 217 time: 0.0892162
Jun 01 18:53:20.092806 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4dd83f6-3b0d-4b44-924c-26323f98ac2a x-openstack-request-id: req-e4dd83f6-3b0d-4b44-924c-26323f98ac2a {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:20.093572 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:20.094768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e4dd83f6-3b0d-4b44-924c-26323f98ac2a {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:20.094768 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'status': 'completed', 'code': 200}
Jun 01 18:53:20.140011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-0f35f3a2-c50e-4431-8e8b-5174c69bbd52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:20.141645 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-0f35f3a2-c50e-4431-8e8b-5174c69bbd52 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0881426
Jun 01 18:53:20.228112 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-b6d1a691-c18a-4646-bb1f-da97e231656f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:20.229634 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-b6d1a691-c18a-4646-bb1f-da97e231656f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0783684
Jun 01 18:53:20.370469 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-4f98f13c-8466-49a6-8631-5d4fa420ac50 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1325157
Jun 01 18:53:20.528830 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15b8db8a-98e9-4ab7-af8f-58a64e15f5c2 req-978ad96f-fba5-4f91-b184-3f880b78dea5 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1501536
Jun 01 18:53:20.670790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-972aeeb3-34ce-431f-a856-4442644e1e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:20.672241 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-972aeeb3-34ce-431f-a856-4442644e1e89 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1097 time: 0.0896628
Jun 01 18:53:20.820258 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-a9c2847b-3797-4ec0-880f-97e55e37f94b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:20.822004 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-a9c2847b-3797-4ec0-880f-97e55e37f94b service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1423039
Jun 01 18:53:20.899329 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-9685ed26-145e-4539-a417-eca0b61a4f48 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 200  len: 217 time: 0.0690041
Jun 01 18:53:21.000409 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-9fd5b0f7-df0d-458d-b74e-4b8aa5564416 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:21.002369 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-9fd5b0f7-df0d-458d-b74e-4b8aa5564416 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0942101
Jun 01 18:53:21.084276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-d5c2c155-9bd3-4278-88ad-bcf562a06a52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:21.085884 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-d5c2c155-9bd3-4278-88ad-bcf562a06a52 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0756497
Jun 01 18:53:21.202427 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aeb0ef1-6e21-4f2a-8298-671243066ff9 req-4e1957f8-ce4b-4bd9-b4bf-3d7db4702256 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:21.208124 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6aeb0ef1-6e21-4f2a-8298-671243066ff9 req-4e1957f8-ce4b-4bd9-b4bf-3d7db4702256 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.1059775
Jun 01 18:53:21.259931 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6aeb0ef1-6e21-4f2a-8298-671243066ff9 req-4569129b-568f-4462-a297-d8980f2f7264 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0474665
Jun 01 18:53:21.319727 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89b585ed-8f01-4e44-a2c8-223bb5a21b12 req-fc966eec-c725-479e-a792-cf9dc035ff72 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:21.320557 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-89b585ed-8f01-4e44-a2c8-223bb5a21b12 req-fc966eec-c725-479e-a792-cf9dc035ff72 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:53:21.338228 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-882bb4fc-c9ea-4de2-b5fe-b5e72bc76ec5 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2410798
Jun 01 18:53:21.345456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-89b585ed-8f01-4e44-a2c8-223bb5a21b12 req-fc966eec-c725-479e-a792-cf9dc035ff72 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:53:21.347654 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-89b585ed-8f01-4e44-a2c8-223bb5a21b12 req-fc966eec-c725-479e-a792-cf9dc035ff72 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.1907127
Jun 01 18:53:21.585251 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-89b585ed-8f01-4e44-a2c8-223bb5a21b12 req-ab4c81ec-a3bf-4042-ad9d-d2ac2a4dfd15 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2136824
Jun 01 18:53:21.631350 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae21be03-7ccb-43fb-842f-7280a2afbafe req-ef167490-50d3-4c2f-9429-cee22e50fd5e service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2835367
Jun 01 18:53:22.454298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c48ab9-9ea5-4696-926c-3c48f5172395 req-c9b4259e-e53a-4f4c-8a73-71b8ce3830bd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:22.455662 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a7c48ab9-9ea5-4696-926c-3c48f5172395 req-c9b4259e-e53a-4f4c-8a73-71b8ce3830bd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0831878
Jun 01 18:53:22.508655 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a7c48ab9-9ea5-4696-926c-3c48f5172395 req-5053e971-68a9-47f8-b891-4b10715767c6 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470777
Jun 01 18:53:22.811472 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1648abbc-1dc8-4ba3-bd17-f782d248753c req-95c677ba-0aa2-4472-adca-ee7914ce8f1a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:22.812959 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1648abbc-1dc8-4ba3-bd17-f782d248753c req-95c677ba-0aa2-4472-adca-ee7914ce8f1a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.1103292
Jun 01 18:53:22.860675 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1648abbc-1dc8-4ba3-bd17-f782d248753c req-91b8ac00-6055-41f1-84d4-83e6863d5b80 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415525
Jun 01 18:53:23.811381 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8785c31d-f816-4430-bbf3-a2d8fdee6697 req-2cdcb112-f52b-40e9-84e1-b16dd0280ac5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:23.812768 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8785c31d-f816-4430-bbf3-a2d8fdee6697 req-2cdcb112-f52b-40e9-84e1-b16dd0280ac5 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.1903880
Jun 01 18:53:23.866900 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8785c31d-f816-4430-bbf3-a2d8fdee6697 req-2ab22b11-7a1e-4cfe-bac9-20c07e15ccba tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476842
Jun 01 18:53:24.061112 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b368b8d-c607-4401-b0e9-cfb7b17903a5 req-1733cb85-97c9-4ac1-89d0-7a1dce6d46a1 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:24.063424 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b368b8d-c607-4401-b0e9-cfb7b17903a5 req-1733cb85-97c9-4ac1-89d0-7a1dce6d46a1 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.0912585
Jun 01 18:53:24.116685 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b368b8d-c607-4401-b0e9-cfb7b17903a5 req-f4571012-9e88-4b3c-a3ad-2c9158832360 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0466609
Jun 01 18:53:25.073594 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2fc9a09-ea5b-4952-8f1d-9645e296599f req-9773735c-8ec4-43ba-8b92-0fdfa9d53897 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:25.075048 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2fc9a09-ea5b-4952-8f1d-9645e296599f req-9773735c-8ec4-43ba-8b92-0fdfa9d53897 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0921750
Jun 01 18:53:25.121158 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b2fc9a09-ea5b-4952-8f1d-9645e296599f req-aeaf9ae6-b235-4b76-b21b-cde63bad8932 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396304
Jun 01 18:53:25.310398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15338fd7-4e23-46d6-af36-2c5b486499a7 req-c4502848-1d0f-488d-a251-90e863d798d8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:25.311972 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15338fd7-4e23-46d6-af36-2c5b486499a7 req-c4502848-1d0f-488d-a251-90e863d798d8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.0844965
Jun 01 18:53:25.365347 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15338fd7-4e23-46d6-af36-2c5b486499a7 req-c9cf95e7-53e2-427c-9c96-d2e725078f23 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467739
Jun 01 18:53:26.326580 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e113a69-af9d-4195-abb2-43c0d0291cf4 req-8402b33d-b040-4599-875f-4b689500f385 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:26.328204 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5e113a69-af9d-4195-abb2-43c0d0291cf4 req-8402b33d-b040-4599-875f-4b689500f385 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0859208
Jun 01 18:53:26.372234 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5e113a69-af9d-4195-abb2-43c0d0291cf4 req-e38128b0-5dbe-4e38-a28b-35e96d1e6b0b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377548
Jun 01 18:53:26.546681 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ef7953-6df3-463f-9b45-1ad06ffe5ae9 req-ab3ee82e-46ac-4ec2-9c3f-fff315d2e0c8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:26.548025 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-78ef7953-6df3-463f-9b45-1ad06ffe5ae9 req-ab3ee82e-46ac-4ec2-9c3f-fff315d2e0c8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.0789242
Jun 01 18:53:26.590455 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-78ef7953-6df3-463f-9b45-1ad06ffe5ae9 req-7e3846c7-5fab-4ae4-b792-5d61d79f426a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0368552
Jun 01 18:53:26.935646 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-b9406f62-c5f8-4dfb-911e-a895e672b9a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:26.937124 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-b9406f62-c5f8-4dfb-911e-a895e672b9a9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1098 time: 0.0733650
Jun 01 18:53:27.070428 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-f8f2ede8-4823-4bc1-af05-993e0ff4a6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:27.071861 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-f8f2ede8-4823-4bc1-af05-993e0ff4a6ad service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.1245265
Jun 01 18:53:27.173345 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-ffcf4fc4-b2c4-4e9e-a1ae-a4bc3d30fc03 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 1001 time: 0.0937831
Jun 01 18:53:27.235328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-807d4bde-df7d-4779-ab9c-fab07ec5299e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:27.236684 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-807d4bde-df7d-4779-ab9c-fab07ec5299e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.0560534
Jun 01 18:53:27.312172 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-2fbda739-0057-49b9-91fc-36511484ce2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:27.313652 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-2fbda739-0057-49b9-91fc-36511484ce2c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700476
Jun 01 18:53:27.444371 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-936ed40e-f49a-461a-a2fc-f4c5503f98e1 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1230161
Jun 01 18:53:27.485133 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ae69b620-8054-4500-b3ca-90716cc72e67 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:53:27.569739 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab07f6-bf4b-4e6d-acfc-ec6551d412ef req-3fb058c0-fe68-4862-8322-80c4a438270d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:27.571214 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-62ab07f6-bf4b-4e6d-acfc-ec6551d412ef req-3fb058c0-fe68-4862-8322-80c4a438270d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0907032
Jun 01 18:53:27.581956 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-687cee3f-2e68-47a3-9725-5ddb05cae4a9 req-9e64111d-d5b2-4efc-9119-aeddf1b2e88c service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1292586
Jun 01 18:53:27.616948 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-62ab07f6-bf4b-4e6d-acfc-ec6551d412ef req-a4268577-8afc-4487-bb38-f47b44876914 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397210
Jun 01 18:53:27.653242 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ae69b620-8054-4500-b3ca-90716cc72e67,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:27.666938 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'port_id': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'mac_address': 'fa:16:3e:3e:36:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 81, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:53:27.724394 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:27.740980 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ae69b620-8054-4500-b3ca-90716cc72e67 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:53:27.756754 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ae69b620-8054-4500-b3ca-90716cc72e67,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:27.761789 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:27.763526 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:27.781560 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d7ca03-56f4-4451-91a8-5334506d0f5b req-1413bd13-5de1-4139-a9ae-d8b056ab7f1a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:27.783542 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15d7ca03-56f4-4451-91a8-5334506d0f5b req-1413bd13-5de1-4139-a9ae-d8b056ab7f1a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 944 time: 0.0838940
Jun 01 18:53:27.826872 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-15d7ca03-56f4-4451-91a8-5334506d0f5b req-b119997f-e41b-4b4b-8a4d-68b3f6665983 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0373983
Jun 01 18:53:27.827084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:27.830068 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:28.034219 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['ae69b620-8054-4500-b3ca-90716cc72e67'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:53:28.805711 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2329eec-6f52-4349-a89d-fe37408a878f req-0eb1b5a5-a9bd-429b-b543-f54568702386 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:28.807156 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d2329eec-6f52-4349-a89d-fe37408a878f req-0eb1b5a5-a9bd-429b-b543-f54568702386 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 945 time: 0.0789626
Jun 01 18:53:28.853232 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d2329eec-6f52-4349-a89d-fe37408a878f req-e9032a25-ddec-4031-a098-6d2cb12893c4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405648
Jun 01 18:53:29.006589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab69e1e2-19a9-4a74-bbe6-c19a2d02979a req-4f0479ee-f95b-4aca-8ed5-99188c3354b7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:29.008005 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab69e1e2-19a9-4a74-bbe6-c19a2d02979a req-4f0479ee-f95b-4aca-8ed5-99188c3354b7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 945 time: 0.0777714
Jun 01 18:53:29.054008 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ab69e1e2-19a9-4a74-bbe6-c19a2d02979a req-4b41e631-12f2-4778-a4de-867e7aad5c8f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405147
Jun 01 18:53:29.500100 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ae69b620-8054-4500-b3ca-90716cc72e67 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:29.569239 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port ae69b620-8054-4500-b3ca-90716cc72e67 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:53:29.573541 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port ae69b620-8054-4500-b3ca-90716cc72e67 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:29.573927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:29.687637 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:29.713660 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:29.715877 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c82dcd33-1a7b-4e30-8bb3-f4a983beb7a3" -d '{"events": [{"server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "name": "network-vif-plugged", "status": "completed", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:29.723717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ae69b620-8054-4500-b3ca-90716cc72e67,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:29.727646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:29.728654 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:53:29.757672 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:29.796797 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e86feb8-367e-4d0e-b001-5ce14b830974 x-openstack-request-id: req-0e86feb8-367e-4d0e-b001-5ce14b830974 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:29.797089 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "name": "network-vif-plugged", "status": "completed", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:29.797348 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-0e86feb8-367e-4d0e-b001-5ce14b830974 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:29.797733 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'code': 200}
Jun 01 18:53:29.850787 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:29.882015 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:29.907557 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:29.941698 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:29.945815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:29.947645 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:30.016125 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=8']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:30.019398 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:30.093013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e6b3b4-284b-4e9f-aa85-4adb3a734892 req-072824de-af8a-485f-8259-bdea525eeba1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:30.094440 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c7e6b3b4-284b-4e9f-aa85-4adb3a734892 req-072824de-af8a-485f-8259-bdea525eeba1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.1303370
Jun 01 18:53:30.247473 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c7e6b3b4-284b-4e9f-aa85-4adb3a734892 req-10d5ecf8-5386-4ac0-b92d-18bb8ab45bfc tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1424687
Jun 01 18:53:30.249379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec2c52b-3e5d-4ef2-9005-5209a51e16ce req-cbd73866-6bbd-4460-aa80-c07fb46c33ba tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:30.249877 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7119a43d-75b6-46f4-88a8-c14e3ca2a312 req-45e2084e-f929-4b9a-aa6e-ca0c157cf010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:30.251157 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ec2c52b-3e5d-4ef2-9005-5209a51e16ce req-cbd73866-6bbd-4460-aa80-c07fb46c33ba tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0831463
Jun 01 18:53:30.251287 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7119a43d-75b6-46f4-88a8-c14e3ca2a312 req-45e2084e-f929-4b9a-aa6e-ca0c157cf010 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1099 time: 0.2072973
Jun 01 18:53:30.296302 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7119a43d-75b6-46f4-88a8-c14e3ca2a312 req-34cff4d2-47bb-4e88-9d67-a691480507ed service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0352466
Jun 01 18:53:30.299118 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ec2c52b-3e5d-4ef2-9005-5209a51e16ce req-7ca173ed-878a-4602-bf55-309ac1aa1a85 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420218
Jun 01 18:53:31.508920 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3ae2c2-5249-4585-8c0e-96bb2be39b28 req-2c82d6b5-1142-4603-a186-89167dd5ae65 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:31.510538 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7b3ae2c2-5249-4585-8c0e-96bb2be39b28 req-2c82d6b5-1142-4603-a186-89167dd5ae65 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0907669
Jun 01 18:53:31.556374 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7b3ae2c2-5249-4585-8c0e-96bb2be39b28 req-cdfc9371-6ab5-4656-b859-4cb269f4f5f7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401392
Jun 01 18:53:31.742562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e25a65-d899-4f16-9b02-dc1636167136 req-374ecfad-23f6-41e1-98fb-26ad0e8992e2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:31.744068 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1e25a65-d899-4f16-9b02-dc1636167136 req-374ecfad-23f6-41e1-98fb-26ad0e8992e2 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0903051
Jun 01 18:53:31.760927 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f65248c-e35c-4dd5-989e-0fb6f7f97bee req-8556ab30-6a85-48ce-862c-71db1805b38d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:31.762244 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f65248c-e35c-4dd5-989e-0fb6f7f97bee req-8556ab30-6a85-48ce-862c-71db1805b38d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0914149
Jun 01 18:53:31.797333 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e1e25a65-d899-4f16-9b02-dc1636167136 req-03e256d7-c7ac-4c5f-98cc-e1b8ed588cf8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464404
Jun 01 18:53:31.801580 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:31.804535 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20cfd957-dff5-453e-8826-2abbae80d80d" -d '{"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-unplugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:31.809936 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7f65248c-e35c-4dd5-989e-0fb6f7f97bee req-5841f921-44eb-44e9-b15c-0de17f9eb643 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411975
Jun 01 18:53:31.836145 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39580) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:31.862129 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-508a7105-fbd7-44f6-9f62-7608adbac378 x-openstack-request-id: req-508a7105-fbd7-44f6-9f62-7608adbac378 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:31.862432 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-unplugged", "status": "failed", "tag": "1151ad48-db08-470c-a31f-319eab029862", "code": 422}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:31.862697 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-508a7105-fbd7-44f6-9f62-7608adbac378 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:31.863098 dv-cinder-794021-1-iscsi neutron-server[98260]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'code': 422} returned with failed status
Jun 01 18:53:32.013610 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f4f8266-5971-401f-a155-13255e901cc1 tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:32.015016 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-1f4f8266-5971-401f-a155-13255e901cc1 tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1094 time: 0.1778293
Jun 01 18:53:32.018593 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39588) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:32.018919 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-71f783bb-07f0-405b-83da-762cb65659d1 service neutron] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1027586
Jun 01 18:53:32.023482 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'port_id': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address': '172.20.0.11'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:53:32.029989 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:53:32.034411 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:floatingip and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:53:32.037301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:53:32.043066 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:53:32.053624 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:32.192789 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:32.332654 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.27.0.107 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/523fbb39-b0e1-48a0-a920-3dc5de62ab10) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:53:32.489855 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:32.522005 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:32.532101 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:32.591929 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:53:32.594825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:53:32.603416 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:53:32.650822 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=523fbb39-b0e1-48a0-a920-3dc5de62ab10,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:32.671374 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.671745 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.672109 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.672489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.672855 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.673205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.674090 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.674441 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.674791 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.675138 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.675481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.675825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:53:32.681311 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:33.013334 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae465898-766d-451b-9642-554910635b59 req-446ab087-db65-4d66-8b1d-ba616daf7e9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.014946 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-446ab087-db65-4d66-8b1d-ba616daf7e9c service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337&tenant_id=41638d3f0658425aa2f15362df9748a1 HTTP/1.1" status: 200  len: 1096 time: 0.1415849
Jun 01 18:53:33.027681 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd9858b-9efa-4f90-98c3-d46811ceec81 req-598c26fe-efd3-41bb-996b-6ed51daec8af tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.029444 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3fd9858b-9efa-4f90-98c3-d46811ceec81 req-598c26fe-efd3-41bb-996b-6ed51daec8af tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.1088836
Jun 01 18:53:33.058842 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:33.127727 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3fd9858b-9efa-4f90-98c3-d46811ceec81 req-bf7a447c-8a6c-46b8-bd6e-7e5cebce81db tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0913978
Jun 01 18:53:33.149514 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae465898-766d-451b-9642-554910635b59 req-d863a402-c599-4057-9672-c0a3a27ab0a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.151115 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-d863a402-c599-4057-9672-c0a3a27ab0a9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=41638d3f0658425aa2f15362df9748a1&device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1096 time: 0.1012502
Jun 01 18:53:33.253204 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:33.302257 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae465898-766d-451b-9642-554910635b59 req-7ed49595-7e09-4c11-bb06-fd0bb2ec09ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.303741 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-7ed49595-7e09-4c11-bb06-fd0bb2ec09ef service neutron] 10.222.0.25 "GET /v2.0/networks?id=d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 200  len: 917 time: 0.1396158
Jun 01 18:53:33.408912 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-17f0581b-505e-404a-a4c2-1426e84c1aca service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 200  len: 999 time: 0.0971229
Jun 01 18:53:33.464607 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:33.469248 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:33.472896 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-af868c23-31de-43f4-825d-ab670707138e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:33.475150 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae465898-766d-451b-9642-554910635b59 req-dba93da5-eef9-4eb0-8b3a-4428b6f4193a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.476645 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-dba93da5-eef9-4eb0-8b3a-4428b6f4193a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 200  len: 856 time: 0.0608220
Jun 01 18:53:33.514180 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:53:33.556184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae465898-766d-451b-9642-554910635b59 req-c7bd33ac-99d3-47ee-a804-de2a152f99cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:33.557695 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-c7bd33ac-99d3-47ee-a804-de2a152f99cd service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=d5efada3-47d7-493b-989f-ef9ac42a4054&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0708406
Jun 01 18:53:33.574066 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=523fbb39-b0e1-48a0-a920-3dc5de62ab10,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:33.581611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:33.590592 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:33.694553 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-e5fd82fb-c20d-407a-877e-60a025b50382 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1281576
Jun 01 18:53:33.770055 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 22d10692-4f6e-4d14-afbc-e04c94671322 associated. External IP: 172.27.0.107, port: ae69b620-8054-4500-b3ca-90716cc72e67.
Jun 01 18:53:33.829038 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae465898-766d-451b-9642-554910635b59 req-06acb09b-d517-4d56-b42a-1f528a6a7a36 service neutron] 10.222.0.25 "GET /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1278293
Jun 01 18:53:34.134079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:53:34.384131 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:53:34.396408 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:53:34.410417 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:34.411072 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cde6c670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:34.430102 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd92bae-b57d-4225-af66-c4b665f73fbb req-075ae7ba-ee29-43c5-a0cb-989e5feab0a0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:34.437148 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-abd92bae-b57d-4225-af66-c4b665f73fbb req-075ae7ba-ee29-43c5-a0cb-989e5feab0a0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.1500044
Jun 01 18:53:34.462652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:34.567573 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-abd92bae-b57d-4225-af66-c4b665f73fbb req-66b5cb94-84b7-4294-959c-46a4a2a29b8c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1293411
Jun 01 18:53:34.601188 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.5812058
Jun 01 18:53:34.602139 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:34.604707 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-912294be-bb04-44e2-9cb9-20370477554f" -d '{"events": [{"name": "network-changed", "server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:34.735081 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77aaf813-7d8d-49ee-a168-a512ee810531 x-openstack-request-id: req-77aaf813-7d8d-49ee-a168-a512ee810531 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:34.735419 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:34.735768 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-77aaf813-7d8d-49ee-a168-a512ee810531 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:34.736251 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'status': 'completed', 'code': 200}
Jun 01 18:53:34.834854 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:35.282248 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cde6c670>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '22d10692-4f6e-4d14-afbc-e04c94671322', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:3e:36:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:53:32Z', 'updated_at': '2021-06-01T18:53:32Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:35.286069 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:53:35.294634 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:35.295247 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cde6c670>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:35.427603 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726f197d-9f73-44b7-a14d-a6f8128f6804 req-414e45b9-b075-49a5-8b5f-c90624849be5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:35.429071 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-726f197d-9f73-44b7-a14d-a6f8128f6804 req-414e45b9-b075-49a5-8b5f-c90624849be5 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0913799
Jun 01 18:53:35.480267 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-726f197d-9f73-44b7-a14d-a6f8128f6804 req-903443c0-5bfb-400f-82a0-4f5a2bbdbb5a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442731
Jun 01 18:53:35.512734 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:35.781830 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526fcfdb-c158-487b-9d62-fff9c24cc54c req-790c3a4a-8d55-441b-9e49-1e7affca5593 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:35.783340 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-526fcfdb-c158-487b-9d62-fff9c24cc54c req-790c3a4a-8d55-441b-9e49-1e7affca5593 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0921907
Jun 01 18:53:35.844625 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-526fcfdb-c158-487b-9d62-fff9c24cc54c req-b0a8741c-f6b9-4228-8fec-4ce4a1c3424f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0543516
Jun 01 18:53:35.900474 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cde6c670>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '22d10692-4f6e-4d14-afbc-e04c94671322', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:3e:36:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:53:32Z', 'updated_at': '2021-06-01T18:53:32Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:35.904725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d985098-6aa8-44e7-8a41-34710a09d3c4 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '22d10692-4f6e-4d14-afbc-e04c94671322', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:3e:36:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:53:32Z', 'updated_at': '2021-06-01T18:53:32Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:53:36.105347 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e586fb41-519b-4dad-9278-14b2ed7edb9d None None] New status for floating IP 22d10692-4f6e-4d14-afbc-e04c94671322: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:53:36.673605 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42e5bfb-9f66-40fa-8b65-dcfa7101be7d req-a9bfd129-98f6-4edb-b1d6-7f0929f314cb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:36.675158 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b42e5bfb-9f66-40fa-8b65-dcfa7101be7d req-a9bfd129-98f6-4edb-b1d6-7f0929f314cb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0858991
Jun 01 18:53:36.722311 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b42e5bfb-9f66-40fa-8b65-dcfa7101be7d req-e8b56348-2c57-4495-ad1f-3b6f75d55d4d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411808
Jun 01 18:53:37.146459 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd79c16-8e89-4802-b7ba-331d19e54c5c req-3a586f08-09a2-4a87-ada2-db75af38719d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:37.148012 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6fd79c16-8e89-4802-b7ba-331d19e54c5c req-3a586f08-09a2-4a87-ada2-db75af38719d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.1982896
Jun 01 18:53:37.195610 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6fd79c16-8e89-4802-b7ba-331d19e54c5c req-4cfb4d35-9c63-4a30-96cb-30432324a0e9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412352
Jun 01 18:53:37.917984 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888b2417-1f59-4e8c-984f-b0d8f17681ca req-e8af65e2-2178-44d7-9854-2029f22b5ba9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:37.919425 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-888b2417-1f59-4e8c-984f-b0d8f17681ca req-e8af65e2-2178-44d7-9854-2029f22b5ba9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0853798
Jun 01 18:53:37.968019 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-888b2417-1f59-4e8c-984f-b0d8f17681ca req-d626876b-e9f5-4385-8b0d-5c3b44a3116d tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429265
Jun 01 18:53:38.386385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b646b872-4850-4d43-a6f8-5fb0fc41e5b8 req-2fd226f8-0f27-4291-9402-286f5be27943 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:38.387812 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b646b872-4850-4d43-a6f8-5fb0fc41e5b8 req-2fd226f8-0f27-4291-9402-286f5be27943 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0841451
Jun 01 18:53:38.446182 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b646b872-4850-4d43-a6f8-5fb0fc41e5b8 req-eed99071-dadd-4d08-9368-5ad9495cddf3 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0518277
Jun 01 18:53:39.166723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dc25ce-067b-4418-98c5-ab266524746c req-1ef6e776-b4e6-47d8-b8f9-21aa366c8422 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:39.168375 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c6dc25ce-067b-4418-98c5-ab266524746c req-1ef6e776-b4e6-47d8-b8f9-21aa366c8422 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0844307
Jun 01 18:53:39.301558 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c6dc25ce-067b-4418-98c5-ab266524746c req-d91af3b3-e769-4838-bf5c-11cc769bac8c tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1269085
Jun 01 18:53:39.637599 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c8c4cf-eb80-4f66-ad05-724e645b462c req-c28bff09-f4f1-4b82-ae78-251901a2817c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:39.639595 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c3c8c4cf-eb80-4f66-ad05-724e645b462c req-c28bff09-f4f1-4b82-ae78-251901a2817c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0862517
Jun 01 18:53:39.690112 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c3c8c4cf-eb80-4f66-ad05-724e645b462c req-4fa08479-a47f-45f1-90a6-b098940e4978 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442572
Jun 01 18:53:40.492840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a4ef84-3fde-4570-ab99-8fd02eb4e914 req-da9f7b04-8e3c-42e3-9ada-83ff590f7245 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:40.493415 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-55a4ef84-3fde-4570-ab99-8fd02eb4e914 req-da9f7b04-8e3c-42e3-9ada-83ff590f7245 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0840523
Jun 01 18:53:40.538211 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-55a4ef84-3fde-4570-ab99-8fd02eb4e914 req-d65f429d-0078-495b-9dac-eff211c597a0 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394320
Jun 01 18:53:40.822300 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:40.889750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019a93f1-f2d1-4387-8aaf-08355ff5c5b3 req-69a7af5d-0d0f-4ef5-a0b9-d33357febcdd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:40.891244 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-019a93f1-f2d1-4387-8aaf-08355ff5c5b3 req-69a7af5d-0d0f-4ef5-a0b9-d33357febcdd tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0846763
Jun 01 18:53:40.936728 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-019a93f1-f2d1-4387-8aaf-08355ff5c5b3 req-a793063c-45b5-4c83-a65d-f6cc885e2340 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387290
Jun 01 18:53:41.729505 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2365c3-10fc-43cc-9634-3b8c11ee8f08 req-e0797a94-ab82-4937-a5b1-2a0689571d1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:41.731142 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f2365c3-10fc-43cc-9634-3b8c11ee8f08 req-e0797a94-ab82-4937-a5b1-2a0689571d1a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0853977
Jun 01 18:53:41.785016 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f2365c3-10fc-43cc-9634-3b8c11ee8f08 req-8a3311fe-4fbe-487d-8bef-514530abed28 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434871
Jun 01 18:53:42.134437 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717bce9b-4101-4141-b134-f4224eb8964b req-975f9e76-0803-4dfd-9b41-c21a946e26b4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:42.137303 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-717bce9b-4101-4141-b134-f4224eb8964b req-975f9e76-0803-4dfd-9b41-c21a946e26b4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0861642
Jun 01 18:53:42.190876 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-717bce9b-4101-4141-b134-f4224eb8964b req-e88c2c8c-c251-4f84-8b77-32544f00970d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437250
Jun 01 18:53:42.980063 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41964f0f-4918-4da8-ae2a-b1c649f7e4f6 req-1bbdb90f-3c07-409c-8130-f239ae931ebc tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:42.981524 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-41964f0f-4918-4da8-ae2a-b1c649f7e4f6 req-1bbdb90f-3c07-409c-8130-f239ae931ebc tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0786152
Jun 01 18:53:43.030463 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-41964f0f-4918-4da8-ae2a-b1c649f7e4f6 req-7f18e3b8-47ae-4fab-a45d-8294e97d6c48 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432079
Jun 01 18:53:43.383611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36123bf6-34cb-49b5-937e-4e5ae7a2e6e6 req-ffc556f5-4ff1-4748-bfaa-da902bd78bb8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:43.385048 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-36123bf6-34cb-49b5-937e-4e5ae7a2e6e6 req-ffc556f5-4ff1-4748-bfaa-da902bd78bb8 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0825477
Jun 01 18:53:43.432455 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-36123bf6-34cb-49b5-937e-4e5ae7a2e6e6 req-c8761d85-e292-494c-8c74-74f4109bb04d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413296
Jun 01 18:53:44.135622 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-15e9f30a-31aa-4d85-b29f-5d40fd44546c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:44.232401 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b62b9d0c-5468-4c8c-b1b8-4026f80213c0 req-a8801bf5-a36d-4da4-9287-79ab2cb3b289 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:44.234089 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b62b9d0c-5468-4c8c-b1b8-4026f80213c0 req-a8801bf5-a36d-4da4-9287-79ab2cb3b289 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0885444
Jun 01 18:53:44.279559 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b62b9d0c-5468-4c8c-b1b8-4026f80213c0 req-6e8af25f-93ef-415e-93be-2676ba897faf tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397615
Jun 01 18:53:44.625122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed6add0-7ab0-437c-a0c0-9b0fdca67b03 req-03933491-9fa2-47b1-ab8a-dfe71aa6daa9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:44.626575 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ed6add0-7ab0-437c-a0c0-9b0fdca67b03 req-03933491-9fa2-47b1-ab8a-dfe71aa6daa9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0828683
Jun 01 18:53:44.675078 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1ed6add0-7ab0-437c-a0c0-9b0fdca67b03 req-6fe56746-410e-43fe-979d-0dee04ee9c85 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428226
Jun 01 18:53:45.417326 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912294be-bb04-44e2-9cb9-20370477554f req-0d8ad553-ba13-42c9-9ad4-c67e1ac8036e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.418776 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-0d8ad553-ba13-42c9-9ad4-c67e1ac8036e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1099 time: 0.0701187
Jun 01 18:53:45.442539 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-d99f1c27-6b43-4670-be19-a01ceb7bf28e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1230299
Jun 01 18:53:45.474966 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d969535-37c8-4725-87e6-9aa2cdf5c506 req-1672441c-91aa-4b71-a911-5933e2562c3a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.476483 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5d969535-37c8-4725-87e6-9aa2cdf5c506 req-1672441c-91aa-4b71-a911-5933e2562c3a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0884037
Jun 01 18:53:45.553723 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912294be-bb04-44e2-9cb9-20370477554f req-0e6c19f1-8209-4ea9-a3b5-55b0b68ac137 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.555928 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-0e6c19f1-8209-4ea9-a3b5-55b0b68ac137 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1295784
Jun 01 18:53:45.557997 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5d969535-37c8-4725-87e6-9aa2cdf5c506 req-cc1e34a8-23db-4076-b37b-9bd50a25e799 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0756414
Jun 01 18:53:45.592935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f723c674-f352-464d-ac04-7a97302b93cf req-54797bb3-f25e-48fc-9682-e9b22db21cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.594381 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-54797bb3-f25e-48fc-9682-e9b22db21cbe service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.0763869
Jun 01 18:53:45.661355 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-ff01df19-3f85-4f33-b3fc-fc7a29835136 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 200  len: 1002 time: 0.0985870
Jun 01 18:53:45.729012 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912294be-bb04-44e2-9cb9-20370477554f req-06ba8f2b-5a52-42c2-b95d-08c14a73e523 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.730462 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-06ba8f2b-5a52-42c2-b95d-08c14a73e523 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0612242
Jun 01 18:53:45.741412 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f723c674-f352-464d-ac04-7a97302b93cf req-87d3f85a-5c59-4a4b-8924-88f1bd00ebdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.742832 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-87d3f85a-5c59-4a4b-8924-88f1bd00ebdb service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.1274893
Jun 01 18:53:45.849039 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-f30e8257-4650-4c47-81b2-b14399379213 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 1001 time: 0.0977995
Jun 01 18:53:45.870092 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912294be-bb04-44e2-9cb9-20370477554f req-bfed5a00-f8fe-4abc-8cf3-88ce15043466 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.871535 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-bfed5a00-f8fe-4abc-8cf3-88ce15043466 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1337419
Jun 01 18:53:45.910646 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f723c674-f352-464d-ac04-7a97302b93cf req-b68f8174-621d-4ea1-8243-2065a5fc9674 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.912062 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-b68f8174-621d-4ea1-8243-2065a5fc9674 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0561640
Jun 01 18:53:45.925992 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97dd4df-037e-4d79-a46e-3abdfe5c1f5e req-bd9de303-615a-4890-a506-29ef620faa8d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.927420 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f97dd4df-037e-4d79-a46e-3abdfe5c1f5e req-bd9de303-615a-4890-a506-29ef620faa8d tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.1342814
Jun 01 18:53:45.986776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f723c674-f352-464d-ac04-7a97302b93cf req-3e1a1be2-a3f4-426f-9ec0-bec1ae1ac890 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:45.988237 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-3e1a1be2-a3f4-426f-9ec0-bec1ae1ac890 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0690398
Jun 01 18:53:46.035149 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f97dd4df-037e-4d79-a46e-3abdfe5c1f5e req-695417f6-12ea-4538-b385-7e2a632c015a tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1007326
Jun 01 18:53:46.051794 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-2882b69e-d094-4678-bd5a-7f74415fcdba service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1723104
Jun 01 18:53:46.118107 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-860c5212-a225-4d4c-9fc1-df32baae1ad4 service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1223562
Jun 01 18:53:46.184574 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-912294be-bb04-44e2-9cb9-20370477554f req-a900d7a0-79f1-4dcb-90c5-f68491205483 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1256459
Jun 01 18:53:46.222037 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:53:46.249919 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f723c674-f352-464d-ac04-7a97302b93cf req-5a4afc79-1997-49cb-aa91-b11abbb27a1e service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1237161
Jun 01 18:53:46.724093 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cd721f75-4217-4147-8290-e59f3f93765a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:46.754241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6abf1f3-bdae-4741-af11-ffc2813e1f4c req-ca15c210-d1b6-42a7-abf5-201510c802eb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:46.755703 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c6abf1f3-bdae-4741-af11-ffc2813e1f4c req-ca15c210-d1b6-42a7-abf5-201510c802eb tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0878747
Jun 01 18:53:46.801773 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c6abf1f3-bdae-4741-af11-ffc2813e1f4c req-565bf97d-d987-4ff4-95e8-d17a16822f47 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403328
Jun 01 18:53:46.863357 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.224245 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52729459-bdbd-4dbf-8900-fc164641d19b req-caf0b633-7303-4f67-b04e-860afa62cd3b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:47.225691 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-52729459-bdbd-4dbf-8900-fc164641d19b req-caf0b633-7303-4f67-b04e-860afa62cd3b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 943 time: 0.0787678
Jun 01 18:53:47.268906 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-52729459-bdbd-4dbf-8900-fc164641d19b req-54374a75-4666-40df-b478-e5bcac1ca5a1 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377011
Jun 01 18:53:47.326216 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-05143be3-0302-4d80-8923-cb533167f636 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:47.327607 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-05143be3-0302-4d80-8923-cb533167f636 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.0779283
Jun 01 18:53:47.465945 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Deleting port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:47.466270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.544490 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:53:47.679108 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:47.680067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] For port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:47.680446 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.692019 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '1151ad48-db08-470c-a31f-319eab029862', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'port_id': '1151ad48-db08-470c-a31f-319eab029862', 'mac_address': 'fa:16:3e:bd:2c:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 58, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:53:47.747914 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.764295 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:53:47.780229 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:47.784818 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.786542 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:47.854377 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:47.873121 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=9']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:47.876803 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:48.019624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:48.020185 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:48.020185 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Floating IP 907c775f-989e-476e-b669-5010bd453179 disassociated. External IP: 172.27.0.83, port: 2fb95b17-86cc-49d3-8ae6-61048a81d7e9.
Jun 01 18:53:48.020531 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Calling delete_port for 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:53:48.032732 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['1151ad48-db08-470c-a31f-319eab029862'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:53:48.064868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6724c3a3-b280-479e-904d-08d1ec95bc88 req-656e36e3-016c-4f67-ad1b-3bb15753a646 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:48.066315 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6724c3a3-b280-479e-904d-08d1ec95bc88 req-656e36e3-016c-4f67-ad1b-3bb15753a646 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 946 time: 0.1359990
Jun 01 18:53:48.162155 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6724c3a3-b280-479e-904d-08d1ec95bc88 req-3b44f5e0-107f-48b7-be43-c292267df05a tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups?id=398f1790-52b8-4b43-bf30-e5cebc034385&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0884237
Jun 01 18:53:48.187625 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:48.193841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:48.240537 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'Port': ['ID=2fb95b17-86cc-49d3-8ae6-61048a81d7e9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:48.243534 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:48.422095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:53:48.550925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4cf8cf-5536-43ff-a3e4-e91730508a87 req-05f57f39-359c-4296-a3b7-f4996ed50928 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:48.552275 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7e4cf8cf-5536-43ff-a3e4-e91730508a87 req-05f57f39-359c-4296-a3b7-f4996ed50928 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.1727202
Jun 01 18:53:48.597031 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7e4cf8cf-5536-43ff-a3e4-e91730508a87 req-e7cf1802-eee4-4231-909a-850e067843ca tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390453
Jun 01 18:53:48.608247 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:53:48.627610 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:53:48.637347 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:48.638105 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc44a90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:48.684997 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] No DVR routers for this DVR port 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:53:48.687558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:48.690373 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'name': 'network-vif-deleted', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:48.693079 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46c77179-4d60-4cbe-9867-b0a112d2603e" -d '{"events": [{"server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "name": "network-vif-deleted", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:48.709949 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c862d260-fa5c-40c1-92cc-a08b681ffdae req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.25 "DELETE /v2.0/ports/2fb95b17-86cc-49d3-8ae6-61048a81d7e9 HTTP/1.1" status: 204  len: 173 time: 1.3723631
Jun 01 18:53:48.748921 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a59e6eb9-123c-4bb4-bbdc-f4510ad49abf x-openstack-request-id: req-a59e6eb9-123c-4bb4-bbdc-f4510ad49abf {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:48.749150 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5aabc216-01d6-43fe-935a-85b32d23ad4f", "name": "network-vif-deleted", "tag": "2fb95b17-86cc-49d3-8ae6-61048a81d7e9", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:48.749443 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-a59e6eb9-123c-4bb4-bbdc-f4510ad49abf {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:48.749911 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5aabc216-01d6-43fe-935a-85b32d23ad4f', 'name': 'network-vif-deleted', 'tag': '2fb95b17-86cc-49d3-8ae6-61048a81d7e9', 'status': 'completed', 'code': 200}
Jun 01 18:53:48.831822 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:49.174556 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc44a90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:49.178427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:53:49.186905 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:49.187509 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc44a90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:49.331850 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-16ab5e94-1211-414d-8d86-4111e7e5a968 req-04b31230-8795-4385-97d9-c1b48eb4318e tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/ports?device_id=5aabc216-01d6-43fe-935a-85b32d23ad4f HTTP/1.1" status: 200  len: 210 time: 0.0440590
Jun 01 18:53:49.448633 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:49.581187 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:53:49.610040 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:49.759715 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 1151ad48-db08-470c-a31f-319eab029862 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:53:49.760006 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:49.795259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438f6ae1-1536-4d03-afdd-a5c5874d3577 req-e85996c3-e928-4cf3-95f4-fd99cc898e1b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:49.796759 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-438f6ae1-1536-4d03-afdd-a5c5874d3577 req-e85996c3-e928-4cf3-95f4-fd99cc898e1b tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 944 time: 0.0872676
Jun 01 18:53:49.841287 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-438f6ae1-1536-4d03-afdd-a5c5874d3577 req-45eaac22-1440-4c59-b2bf-18af0b5842d7 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383339
Jun 01 18:53:49.926323 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc44a90>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:49.932209 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:49.942599 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fdc7e76-ba17-4265-b326-9ba2b4c1bf27 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:21Z', 'revision_number': 4, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '09837b50-712b-41b5-89e5-267d9d358b31', 'name': '', 'network_id': '87c3456d-8d78-42d4-81e0-1f541c3dcc2f', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'mac_address': 'fa:16:3e:12:3e:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '108da5f2-bebc-4996-9e93-e596166088ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:35Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'subnets': [{'id': '108da5f2-bebc-4996-9e93-e596166088ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:53:49.961666 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:53:49.963928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9cd674db-7c20-4b17-86f0-968e19272a0c" -d '{"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:53:49.972277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:49.977569 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:49.978633 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:53:50.007856 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:50.046201 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:53:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66de34eb-3262-40e8-b700-f7ed10f4e550 x-openstack-request-id: req-66de34eb-3262-40e8-b700-f7ed10f4e550 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:53:50.046493 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-plugged", "status": "completed", "tag": "1151ad48-db08-470c-a31f-319eab029862", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:53:50.046750 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-66de34eb-3262-40e8-b700-f7ed10f4e550 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:53:50.047172 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'code': 200}
Jun 01 18:53:50.054529 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:53:50.054874 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 2fb95b17-86cc-49d3-8ae6-61048a81d7e9 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:53:50.081788 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=10']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:50.084769 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:50.186905 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f50f0bea-4bbb-472e-903b-9fb00f51edd1 None None] New status for floating IP 907c775f-989e-476e-b669-5010bd453179: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:53:50.261763 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9ee1fe-3183-42db-9b55-3e64128fc488 req-d16a7d10-2556-47a1-b4e3-d0fe6503dc9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:50.265423 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1d9ee1fe-3183-42db-9b55-3e64128fc488 req-d16a7d10-2556-47a1-b4e3-d0fe6503dc9d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 1099 time: 0.0732908
Jun 01 18:53:50.310594 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1d9ee1fe-3183-42db-9b55-3e64128fc488 req-9d1affd5-d323-43b6-bf4c-10feb3ed8aff service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382648
Jun 01 18:53:50.468476 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39718) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:50.533652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:50.560158 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:50.611858 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:50.615424 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:50.633790 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=398f1790-52b8-4b43-bf30-e5cebc034385,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:50.636959 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:50.647024 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:50.649038 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "DELETE /v2.0/security-groups/398f1790-52b8-4b43-bf30-e5cebc034385 HTTP/1.1" status: 204  len: 168 time: 0.1790793
Jun 01 18:53:50.651501 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39720) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:50.667933 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.api.v2.resource [None req-eb57c70e-dad6-4913-9415-e8659f60f249 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] show failed (client error): The resource could not be found.
Jun 01 18:53:50.668937 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-eb57c70e-dad6-4913-9415-e8659f60f249 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "GET /v2.0/security-groups/398f1790-52b8-4b43-bf30-e5cebc034385 HTTP/1.1" status: 404  len: 347 time: 0.0165319
Jun 01 18:53:50.671634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39722) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:50.887893 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Deleting port 0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:50.888244 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.008848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.009179 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.047018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2d930-5bbf-4e62-9527-77d75793eea3 req-2d82898f-cba5-44a1-a152-10babf5421a4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:51.049519 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b4d2d930-5bbf-4e62-9527-77d75793eea3 req-2d82898f-cba5-44a1-a152-10babf5421a4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 946 time: 0.0919516
Jun 01 18:53:51.094193 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b4d2d930-5bbf-4e62-9527-77d75793eea3 req-7cec9390-3471-4608-a6ec-d1868564e02e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392039
Jun 01 18:53:51.148112 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Calling delete_port for 0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1 owned by network:floatingip {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:53:51.269040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.273581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0eda0be5-7074-49ca-9e5e-6238ae25fa94 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:51.317568 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Pushing event deleted for resources: {'Port': ['ID=0d2b1ab8-e4a1-4e76-81ef-c0ee557e95f1,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:51.320215 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:51.413381 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks [] for floatingip, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.428046 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:51.429591 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-13216caf-f63d-4051-9d33-0019b23b5efe tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] 10.222.0.22 "DELETE /v2.0/floatingips/907c775f-989e-476e-b669-5010bd453179 HTTP/1.1" status: 204  len: 168 time: 0.7570994
Jun 01 18:53:52.281734 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b77af9d-5b05-4a05-b022-299425e6d40d req-7ec5251b-09bb-40db-8c30-f1fff3c03863 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:53:52.283786 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b77af9d-5b05-4a05-b022-299425e6d40d req-7ec5251b-09bb-40db-8c30-f1fff3c03863 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 946 time: 0.0798035
Jun 01 18:53:52.326147 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b77af9d-5b05-4a05-b022-299425e6d40d req-bb7514ee-f584-47ee-84dc-02b50ccb86d0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0368216
Jun 01 18:53:55.396701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39790) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:56.104947 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:56.504667 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Deleting port 09837b50-712b-41b5-89e5-267d9d358b31 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:56.505375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:56.621637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] For port 09837b50-712b-41b5-89e5-267d9d358b31, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=09837b50-712b-41b5-89e5-267d9d358b31,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:56.621987 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:56.739960 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Calling delete_port for 09837b50-712b-41b5-89e5-267d9d358b31 owned by network:router_interface {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:53:56.892635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:56.897621 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:56.939190 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Pushing event deleted for resources: {'Port': ['ID=09837b50-712b-41b5-89e5-267d9d358b31,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:56.968649 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:57.292686 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:57.638128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:53:57.834539 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:53:57.842692 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Sync routers for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:53:57.846521 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] 10.222.0.22 "PUT /v2.0/routers/e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4470236
Jun 01 18:53:57.848915 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39796) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:57.855500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:57.856117 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd82dd30>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:58.024631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks [] for router, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:58.036947 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:58.200721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:58.278331 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Deleting port c380278f-9756-427c-a730-c226e79202b1 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:58.278593 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:58.382582 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd82dd30>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168'}], 'enable_snat': True}, 'gw_port_id': 'c380278f-9756-427c-a730-c226e79202b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:53:56Z', 'revision_number': 5, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port': {'id': 'c380278f-9756-427c-a730-c226e79202b1', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:52:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:47:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:58.388409 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Checking router: e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:53:58.396523 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Routers {'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:53:58.397158 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd82dd30>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:58.513430 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] For port c380278f-9756-427c-a730-c226e79202b1, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c380278f-9756-427c-a730-c226e79202b1,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:53:58.513786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:58.556505 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] Set router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 gateway port host: None {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:53:58.637050 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Calling delete_port for c380278f-9756-427c-a730-c226e79202b1 owned by network:router_gateway {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:53:58.660176 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd82dd30>, [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:53:58Z', 'revision_number': 6, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:53:58.664064 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48620b4-7c2e-471f-bf16-8eea11d59d43 None None] The sync data for ids ['e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2'] in dv-cinder-794021-1-iscsi is: [{'id': 'e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2', 'name': 'tempest-AttachVolumeTestJSON-423168063-router', 'tenant_id': 'e471347ca004404f94563ac66c74dc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:10Z', 'updated_at': '2021-06-01T18:53:58Z', 'revision_number': 6, 'project_id': 'e471347ca004404f94563ac66c74dc87', 'gw_port_host': None}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:53:58.773259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:58.777237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a16556bf-34ff-4c87-9856-e8f09b7d01a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:58.821497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Pushing event deleted for resources: {'Port': ['ID=c380278f-9756-427c-a730-c226e79202b1,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:58.823787 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:58.911930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.079842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.082719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.110346 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.110890 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 {{(pid=98258) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:53:59.123157 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.124276 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] 10.222.0.22 "DELETE /v2.0/routers/e2d66624-f2ef-48aa-bfb3-ab48bb9b6ca2 HTTP/1.1" status: 204  len: 168 time: 1.2744598
Jun 01 18:53:59.126828 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39798) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:59.186027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Deleting subnet 108da5f2-bebc-4996-9e93-e596166088ad {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:53:59.188863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.236089 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.349213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.596930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.600987 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:53:59.636819 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=108da5f2-bebc-4996-9e93-e596166088ad,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:53:59.638750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.641540 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:53:59.642768 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1edd02d5-3623-42e6-af6b-86f8e658b6b9 None None] Network 87c3456d-8d78-42d4-81e0-1f541c3dcc2f requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:53:59.645975 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-cc467a40-2558-4032-a222-3c77765ed495 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/108da5f2-bebc-4996-9e93-e596166088ad HTTP/1.1" status: 204  len: 168 time: 0.5177069
Jun 01 18:53:59.648351 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39800) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:53:59.755296 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.826104 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Deleting port 8760df71-4d77-4700-92d9-3788d40c0a1a {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:59.826811 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:53:59.888587 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] DHCP port deletion for 87c3456d-8d78-42d4-81e0-1f541c3dcc2f request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:53:59.955630 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Deleting port 8760df71-4d77-4700-92d9-3788d40c0a1a {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:53:59.955935 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.017266 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] For port 8760df71-4d77-4700-92d9-3788d40c0a1a, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8760df71-4d77-4700-92d9-3788d40c0a1a,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:00.017627 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.053611 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] For port 8760df71-4d77-4700-92d9-3788d40c0a1a, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=8760df71-4d77-4700-92d9-3788d40c0a1a,segment=NetworkSegment(65814869-c1b9-439f-bc83-43e6e5c7712d),segment_id=65814869-c1b9-439f-bc83-43e6e5c7712d)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:00.054005 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.136832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Calling delete_port for 8760df71-4d77-4700-92d9-3788d40c0a1a owned by network:dhcp {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:00.172634 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Calling delete_port for 8760df71-4d77-4700-92d9-3788d40c0a1a owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:00.185944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.190581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8182e366-2ca6-4776-81e8-7be9992e5e33 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:00.215717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.219391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:00.234248 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Pushing event deleted for resources: {'Port': ['ID=8760df71-4d77-4700-92d9-3788d40c0a1a,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:00.238131 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:00.238919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] No DVR routers for this DVR port 8760df71-4d77-4700-92d9-3788d40c0a1a on host dv-cinder-794021-1-iscsi {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:00.269599 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 09837b50-712b-41b5-89e5-267d9d358b31 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:00.299529 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Pushing event deleted for resources: {'Port': ['ID=8760df71-4d77-4700-92d9-3788d40c0a1a,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:00.301868 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:00.309248 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] No DVR routers for this DVR port 8760df71-4d77-4700-92d9-3788d40c0a1a on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:00.313075 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 09837b50-712b-41b5-89e5-267d9d358b31 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:00.313428 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 09837b50-712b-41b5-89e5-267d9d358b31 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:00.316837 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c380278f-9756-427c-a730-c226e79202b1 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:00.347835 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: c380278f-9756-427c-a730-c226e79202b1 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:00.348186 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c380278f-9756-427c-a730-c226e79202b1 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:00.348632 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8760df71-4d77-4700-92d9-3788d40c0a1a no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:00.359126 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.371826 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3c7eb39a0>,) {'filters': {'network_id': ['87c3456d-8d78-42d4-81e0-1f541c3dcc2f']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:00.383256 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 8760df71-4d77-4700-92d9-3788d40c0a1a {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:00.383604 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 8760df71-4d77-4700-92d9-3788d40c0a1a not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:00.383885 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7eb39a0>, '65814869-c1b9-439f-bc83-43e6e5c7712d') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:00.384184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7eb39a0>, '65814869-c1b9-439f-bc83-43e6e5c7712d') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:00.396251 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.412815 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.419007 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Releasing vlan 61 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:54:00.419395 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:54:00.432259 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:54:00.511614 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.516444 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.520558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:00.543604 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Pushing event deleted for resources: {'Network': ['ID=87c3456d-8d78-42d4-81e0-1f541c3dcc2f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:00.545857 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:00.554290 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] 10.222.0.22 "DELETE /v2.0/networks/87c3456d-8d78-42d4-81e0-1f541c3dcc2f HTTP/1.1" status: 204  len: 168 time: 0.9047272
Jun 01 18:54:00.664098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39804) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:00.712717 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ddaf2e76-0b8a-45f2-b521-e71d509fb4b4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=e471347ca004404f94563ac66c74dc87&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0472338
Jun 01 18:54:00.714900 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39806) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:00.770838 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.799545 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.850664 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.855419 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-1deebbc4-c000-4637-a642-66a4dd6853bb tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:00.868077 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5599ecda-dc5f-44de-ac90-58679762ae16,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:00.872921 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:00.874855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:00.875966 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/5599ecda-dc5f-44de-ac90-58679762ae16 HTTP/1.1" status: 204  len: 168 time: 0.1601655
Jun 01 18:54:09.522463 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39900) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:09.934176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Deleting port bf9fa831-6b84-418f-8ba1-1e6dad14722d {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:09.934517 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.048006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.048327 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.165905 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Calling delete_port for bf9fa831-6b84-418f-8ba1-1e6dad14722d owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:10.284977 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.288672 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:10.331244 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event deleted for resources: {'Port': ['ID=bf9fa831-6b84-418f-8ba1-1e6dad14722d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:10.333677 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:10.519302 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.519649 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Floating IP 6676a94a-cc1e-4c7d-9493-532fe0d81c3b disassociated (deleted). External IP: 172.27.0.109, port: 0721dbfe-8c91-42f7-b953-19fcbeb01603.
Jun 01 18:54:10.824059 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.858708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 39924) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:10.874167 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Router 950c7042-42b1-4123-9d8b-78b7f84afa7f has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:54:10.974118 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:10.991963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:10.995727 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Usage tracker for resource:security_group_rule and tenant:55c56bcd009246289e858907a6538026 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:10.998514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:11.004193 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:11.056023 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:54:11.065805 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Sync routers for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:54:11.075531 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:11.076147 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb55dc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:11.077545 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.090123 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.094704 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.121942 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0e368f3d-01eb-410b-87e3-67dccaf59924 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:11.133201 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=55c56bcd009246289e858907a6538026&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2709475
Jun 01 18:54:11.133521 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 39928) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:11.147905 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "DELETE /v2.0/floatingips/6676a94a-cc1e-4c7d-9493-532fe0d81c3b HTTP/1.1" status: 204  len: 168 time: 1.6218398
Jun 01 18:54:11.147905 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:54:11.149870 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e" -d '{"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:54:11.154696 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce6f3f38-2553-4ee6-99f8-1c8f6bf48dfb,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:11.158452 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:11.207798 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:54:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c06e4ad8-ec4d-4c97-aecb-71930bea38f7 x-openstack-request-id: req-c06e4ad8-ec4d-4c97-aecb-71930bea38f7 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:54:11.208125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:54:11.208414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-c06e4ad8-ec4d-4c97-aecb-71930bea38f7 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:54:11.208856 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'status': 'completed', 'code': 200}
Jun 01 18:54:11.213402 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.259483 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:11.284302 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.350456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-826fa798-612a-43e4-9a85-4d3528655b70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:11.351978 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-826fa798-612a-43e4-9a85-4d3528655b70 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=85f17a1d02ae4454a980be1331cbe34d&device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 1098 time: 0.1155918
Jun 01 18:54:11.384994 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.393282 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9b3b2c3c-68ee-4b5f-a625-114ae99b3cd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:11.421117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce6f3f38-2553-4ee6-99f8-1c8f6bf48dfb,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:11.423486 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:11.480068 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:11.483667 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ce6f3f38-2553-4ee6-99f8-1c8f6bf48dfb HTTP/1.1" status: 204  len: 168 time: 0.3468068
Jun 01 18:54:11.573632 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-aec2bf36-08d8-44f0-b457-82da63808411 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:11.575088 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-aec2bf36-08d8-44f0-b457-82da63808411 service neutron] 10.222.0.25 "GET /v2.0/networks?id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 200  len: 909 time: 0.2137902
Jun 01 18:54:11.580446 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb55dc0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:11.584451 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Checking router: 950c7042-42b1-4123-9d8b-78b7f84afa7f for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:54:11.593298 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:11.593922 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb55dc0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:53:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:11.649045 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-ed439377-a8fe-4557-801f-3d467e054f33 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 200  len: 217 time: 0.0654974
Jun 01 18:54:11.661704 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1a2527-6a42-4f45-b5e0-b0b19f23c42a req-77d9570a-03a3-4417-9022-5c770f191bf7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:11.662010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-4c1a2527-6a42-4f45-b5e0-b0b19f23c42a req-77d9570a-03a3-4417-9022-5c770f191bf7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Synchronizing usage tracker for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:54:11.724936 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-4c1a2527-6a42-4f45-b5e0-b0b19f23c42a req-77d9570a-03a3-4417-9022-5c770f191bf7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Unset dirty status for tenant:85f17a1d02ae4454a980be1331cbe34d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:54:11.726099 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4c1a2527-6a42-4f45-b5e0-b0b19f23c42a req-77d9570a-03a3-4417-9022-5c770f191bf7 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.2402768
Jun 01 18:54:11.752912 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-d05a3590-a830-48ac-9278-a09fbbd30e4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:11.754466 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-d05a3590-a830-48ac-9278-a09fbbd30e4d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 200  len: 848 time: 0.0888028
Jun 01 18:54:11.812863 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:11.822781 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4c1a2527-6a42-4f45-b5e0-b0b19f23c42a req-da16c53a-142c-40f6-ae57-e54650896b4d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0900888
Jun 01 18:54:11.862821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-bded4830-57c3-4d06-bef1-b78baa1ed031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:11.864446 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-bded4830-57c3-4d06-bef1-b78baa1ed031 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=4fe37e11-4ddd-41fd-b2d4-95525adc3be2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1006682
Jun 01 18:54:12.001077 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-43b76372-665f-4b49-bd4e-5f4ce14994ad service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1290452
Jun 01 18:54:12.149955 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb55dc0>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:12.154685 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f51b3d10-fe40-459a-8642-dc32fff6d71a None None] The sync data for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi is: [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:48:34Z', 'revision_number': 4, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '6c5819c9-ce8d-4a9f-af0d-238929d534aa', 'name': '', 'network_id': '4fe37e11-4ddd-41fd-b2d4-95525adc3be2', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'mac_address': 'fa:16:3e:11:91:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_interface', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:33Z', 'updated_at': '2021-06-01T18:48:42Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'subnets': [{'id': 'e4405465-78ee-42fa-bf1d-3f535d074d0b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:54:12.253980 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d43d66f3-6759-4a3c-b201-60cbb5d7a24e req-a5aa710a-c3c5-4b23-9195-f200ff322f1c service neutron] 10.222.0.25 "GET /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2448695
Jun 01 18:54:12.381279 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4482124b-4988-4455-8340-c7102d989f09 None None] New status for floating IP 6676a94a-cc1e-4c7d-9493-532fe0d81c3b: DOWN {{(pid=98260) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:54:13.020217 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d154d94-c667-4a26-b12a-d00086ae25a3 req-1db6d05d-8b53-4232-b65a-e111c62a3853 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:13.021649 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d154d94-c667-4a26-b12a-d00086ae25a3 req-1db6d05d-8b53-4232-b65a-e111c62a3853 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0837855
Jun 01 18:54:13.067732 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9d154d94-c667-4a26-b12a-d00086ae25a3 req-5da9a94f-e6ee-4eca-b712-fa1ade53f80c tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/security-groups?id=d9074e75-527a-4712-b152-f716718c4332&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399611
Jun 01 18:54:13.268458 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-7af3eb75-1489-4a73-bbe4-08e9dcb51e0d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:13.269884 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-7af3eb75-1489-4a73-bbe4-08e9dcb51e0d tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.25 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 945 time: 0.0860453
Jun 01 18:54:13.409984 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Deleting port 0721dbfe-8c91-42f7-b953-19fcbeb01603 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:13.410336 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.508842 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40000) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:13.547912 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] For port 0721dbfe-8c91-42f7-b953-19fcbeb01603, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0721dbfe-8c91-42f7-b953-19fcbeb01603,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:13.548267 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.630597 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.645275 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:13.649401 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Usage tracker for resource:security_group_rule and tenant:64bda622e728468199631269e0299083 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:13.652263 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:13.657952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:13.671867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Calling delete_port for 0721dbfe-8c91-42f7-b953-19fcbeb01603 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:13.739986 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.744907 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.754168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8e62000e-b133-4683-802a-eb7ca0616c7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:13.783589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.789370 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8d2e4312-77c6-4517-873e-fd7cb18381b4 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:13.794418 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=64bda622e728468199631269e0299083&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2845216
Jun 01 18:54:13.795342 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79d8e756-39d7-4075-8152-8b30966c644a,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:13.797760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40004) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:13.808890 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:13.837066 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event deleted for resources: {'Port': ['ID=0721dbfe-8c91-42f7-b953-19fcbeb01603,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:13.840932 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:13.859093 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.885880 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.916056 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] No DVR routers for this DVR port 0721dbfe-8c91-42f7-b953-19fcbeb01603 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:13.918518 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.921126 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-deleted', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:54:13.923384 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ba04ffa-de6f-4018-b737-5b370ccd276d" -d '{"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-deleted", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:54:13.939226 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d1f3776b-ddb2-4b6d-b0a4-702d26d13be1 req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.25 "DELETE /v2.0/ports/0721dbfe-8c91-42f7-b953-19fcbeb01603 HTTP/1.1" status: 204  len: 173 time: 0.6633198
Jun 01 18:54:13.942422 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.947526 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b6fcaf27-bcd9-4773-9ebc-3f1cd4a4f2e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:13.960133 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79d8e756-39d7-4075-8152-8b30966c644a,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:13.970164 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:13.971406 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:54:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70a38cea-837d-4e15-8e8f-fc77ec6024e5 x-openstack-request-id: req-70a38cea-837d-4e15-8e8f-fc77ec6024e5 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:54:13.971793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b7b036c-b188-4dc3-a2b9-c18a01afbb11", "name": "network-vif-deleted", "tag": "0721dbfe-8c91-42f7-b953-19fcbeb01603", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:54:13.972115 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-70a38cea-837d-4e15-8e8f-fc77ec6024e5 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:54:13.972237 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:13.973405 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b7b036c-b188-4dc3-a2b9-c18a01afbb11', 'name': 'network-vif-deleted', 'tag': '0721dbfe-8c91-42f7-b953-19fcbeb01603', 'status': 'completed', 'code': 200}
Jun 01 18:54:13.976002 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/79d8e756-39d7-4075-8152-8b30966c644a HTTP/1.1" status: 204  len: 168 time: 0.1774583
Jun 01 18:54:14.138190 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-362042d1-e98f-4b75-9300-d5d250d0a7cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.239452 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4f3c1a8a-c873-4878-9528-26d35985baa5 req-13d9869b-b879-4a16-b2c1-7d332f8522fb tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "GET /v2.0/ports?device_id=6b7b036c-b188-4dc3-a2b9-c18a01afbb11 HTTP/1.1" status: 200  len: 210 time: 0.0646110
Jun 01 18:54:14.273155 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40014) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:14.290893 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.306784 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:14.310820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Usage tracker for resource:security_group_rule and tenant:52fdf24ac6e74a8fb91813d3db953eb1 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:14.314122 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:14.320718 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:14.411418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.415543 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.425143 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d755a225-cc7b-41de-b486-61891d2598dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:14.471458 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=52fdf24ac6e74a8fb91813d3db953eb1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1976714
Jun 01 18:54:14.472379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddefda4c-7fca-45dd-a617-b1cd3fe5bd20,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:14.474123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40016) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:14.475792 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c075094e-a022-4553-b1df-bc44ea1af67b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:14.531688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.557122 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.609338 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.612833 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2d0cf603-6e9a-466c-bbeb-6b8ada61b92f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:14.625238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddefda4c-7fca-45dd-a617-b1cd3fe5bd20,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:14.628100 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:14.630508 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:14.637025 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4b88a979-1596-482f-80ef-ad54d71680fa admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ddefda4c-7fca-45dd-a617-b1cd3fe5bd20 HTTP/1.1" status: 204  len: 168 time: 0.1590672
Jun 01 18:54:15.341885 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40040) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:15.500230 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:15.530205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:15.595032 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:15.600692 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-88803604-6615-46d9-87eb-255de35caa62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:15.616534 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9074e75-527a-4712-b152-f716718c4332,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:15.619693 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:15.633495 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:15.634615 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] 10.222.0.22 "DELETE /v2.0/security-groups/d9074e75-527a-4712-b152-f716718c4332 HTTP/1.1" status: 204  len: 168 time: 0.2917650
Jun 01 18:54:15.669531 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:15.676856 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40050) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:15.742384 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 0721dbfe-8c91-42f7-b953-19fcbeb01603 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:15.743037 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0721dbfe-8c91-42f7-b953-19fcbeb01603 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:15.787784 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40056) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:15.928530 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:15.957706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:15.964618 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Usage tracker for resource:security_group_rule and tenant:26fbe8d3e4e046ac8fed2e455aded1a9 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:16.012515 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:16.025683 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:16.318257 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.327130 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.336747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-20bb299a-b6f4-4ddf-b2ce-7f29c09ceaba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:16.413711 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=26fbe8d3e4e046ac8fed2e455aded1a9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6248989
Jun 01 18:54:16.414847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed413a73-7c8c-469d-9a1d-a5598a059724,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:16.416799 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40060) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:16.420087 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:16.489372 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.514671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.522658 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.570750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.575431 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d7be3dec-af02-4dab-88df-153ce45aac84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:16.586133 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed413a73-7c8c-469d-9a1d-a5598a059724,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:16.590602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:16.592487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.593729 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ed413a73-7c8c-469d-9a1d-a5598a059724 HTTP/1.1" status: 204  len: 168 time: 0.1749656
Jun 01 18:54:16.730595 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-01bd7697-5815-45de-84f1-6bbf52d2a3f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.865690 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:16.945067 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Deleting port 6c5819c9-ce8d-4a9f-af0d-238929d534aa {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:16.945418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:17.067523 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] For port 6c5819c9-ce8d-4a9f-af0d-238929d534aa, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=6c5819c9-ce8d-4a9f-af0d-238929d534aa,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:17.067881 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:17.294661 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Calling delete_port for 6c5819c9-ce8d-4a9f-af0d-238929d534aa owned by network:router_interface {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:17.582296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:17.586904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-397a1d9a-ddb5-4ef6-a927-517fa0e3c897 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:17.636187 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=6c5819c9-ce8d-4a9f-af0d-238929d534aa,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:17.663472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:17.823729 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:17.917614 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:18.267061 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Router 950c7042-42b1-4123-9d8b-78b7f84afa7f has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:54:18.440200 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:54:18.448386 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Sync routers for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:54:18.461473 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] 10.222.0.22 "PUT /v2.0/routers/950c7042-42b1-4123-9d8b-78b7f84afa7f/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7832372
Jun 01 18:54:18.462164 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:18.462778 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb5b430>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:18.463848 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40090) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:18.638367 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:18.755507 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks [] for router, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:18.927162 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb5b430>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212'}], 'enable_snat': True}, 'gw_port_id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:54:17Z', 'revision_number': 5, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port': {'id': 'c501936f-0db2-4cfe-8c1d-43b10f874884', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:fd:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 233, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:30Z', 'updated_at': '2021-06-01T18:48:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:18.931113 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Checking router: 950c7042-42b1-4123-9d8b-78b7f84afa7f for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:54:18.931278 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:18.940502 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Routers {'950c7042-42b1-4123-9d8b-78b7f84afa7f'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:18.941019 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb5b430>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['950c7042-42b1-4123-9d8b-78b7f84afa7f'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:19.010809 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Deleting port c501936f-0db2-4cfe-8c1d-43b10f874884 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:19.011156 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.092646 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] Set router 950c7042-42b1-4123-9d8b-78b7f84afa7f gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:19.136382 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] For port c501936f-0db2-4cfe-8c1d-43b10f874884, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=c501936f-0db2-4cfe-8c1d-43b10f874884,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:19.136891 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.197454 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdb5b430>, [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:54:18Z', 'revision_number': 6, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:19.201931 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b30eaf1c-7e4d-4ccd-8da7-67f70a728b8f None None] The sync data for ids ['950c7042-42b1-4123-9d8b-78b7f84afa7f'] in dv-cinder-794021-1-iscsi is: [{'id': '950c7042-42b1-4123-9d8b-78b7f84afa7f', 'name': 'tempest-TestShelveInstance-2140505485-router', 'tenant_id': '85f17a1d02ae4454a980be1331cbe34d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:29Z', 'updated_at': '2021-06-01T18:54:18Z', 'revision_number': 6, 'project_id': '85f17a1d02ae4454a980be1331cbe34d', 'gw_port_host': None}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:54:19.264603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Calling delete_port for c501936f-0db2-4cfe-8c1d-43b10f874884 owned by network:router_gateway {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:19.397755 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.401445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-12909f29-a7f1-4370-aa26-56296ce0e7dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:19.443294 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Pushing event deleted for resources: {'Port': ['ID=c501936f-0db2-4cfe-8c1d-43b10f874884,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:19.446938 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:19.524475 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.534320 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.706963 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.709145 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.729834 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.730448 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 950c7042-42b1-4123-9d8b-78b7f84afa7f {{(pid=98259) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:54:19.742767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.743874 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-fb0ce841-5c59-4e37-a36a-9b6c85d57931 admin admin] 10.222.0.22 "DELETE /v2.0/routers/950c7042-42b1-4123-9d8b-78b7f84afa7f HTTP/1.1" status: 204  len: 168 time: 1.2791443
Jun 01 18:54:19.746415 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40098) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:19.806659 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Deleting subnet e4405465-78ee-42fa-bf1d-3f535d074d0b {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:54:19.809496 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.856455 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:19.935485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.263814 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c501936f-0db2-4cfe-8c1d-43b10f874884 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:20.280820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.290677 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-056b9302-ec28-45da-ba6d-002b2ce2aaca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:20.305548 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: c501936f-0db2-4cfe-8c1d-43b10f874884 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:20.305908 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device c501936f-0db2-4cfe-8c1d-43b10f874884 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:20.306339 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 6c5819c9-ce8d-4a9f-af0d-238929d534aa no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:20.321073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.333056 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e4405465-78ee-42fa-bf1d-3f535d074d0b,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:20.335870 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/e4405465-78ee-42fa-bf1d-3f535d074d0b HTTP/1.1" status: 204  len: 168 time: 0.5884972
Jun 01 18:54:20.336783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7e32e983-61ae-4909-9086-2d75593bf5d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:20.338562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40104) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:20.344306 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24e01140-fa29-4615-8ee2-c55579186e8c None None] Network 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:54:20.358526 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 6c5819c9-ce8d-4a9f-af0d-238929d534aa {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:20.358876 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 6c5819c9-ce8d-4a9f-af0d-238929d534aa not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:20.440930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.516997 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Deleting port 961b4c5c-4330-4095-9c49-9264a1ffe44e {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:20.517391 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.591726 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] DHCP port deletion for 4fe37e11-4ddd-41fd-b2d4-95525adc3be2 request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:54:20.621063 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] For port 961b4c5c-4330-4095-9c49-9264a1ffe44e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=961b4c5c-4330-4095-9c49-9264a1ffe44e,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:20.621415 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.658360 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Deleting port 961b4c5c-4330-4095-9c49-9264a1ffe44e {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:20.658742 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.740942 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Calling delete_port for 961b4c5c-4330-4095-9c49-9264a1ffe44e owned by network:dhcp {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:20.753496 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] For port 961b4c5c-4330-4095-9c49-9264a1ffe44e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=961b4c5c-4330-4095-9c49-9264a1ffe44e,segment=NetworkSegment(78789faf-e362-4dcb-9299-2450da3fd2ca),segment_id=78789faf-e362-4dcb-9299-2450da3fd2ca)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:20.753893 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.787313 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.791957 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-ca3bd926-00ba-4058-8748-a99e4287fc42 tempest-AttachVolumeNegativeTest-1783123680 tempest-AttachVolumeNegativeTest-1783123680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:20.837546 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Pushing event deleted for resources: {'Port': ['ID=961b4c5c-4330-4095-9c49-9264a1ffe44e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:20.840556 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:20.841319 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] No DVR routers for this DVR port 961b4c5c-4330-4095-9c49-9264a1ffe44e on host dv-cinder-794021-1-iscsi {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:20.883405 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Calling delete_port for 961b4c5c-4330-4095-9c49-9264a1ffe44e owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:20.926228 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.930579 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:20.956603 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:20.968780 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3ccfc5910>,) {'filters': {'network_id': ['4fe37e11-4ddd-41fd-b2d4-95525adc3be2']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:20.972635 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Pushing event deleted for resources: {'Port': ['ID=961b4c5c-4330-4095-9c49-9264a1ffe44e,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:20.974912 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] No DVR routers for this DVR port 961b4c5c-4330-4095-9c49-9264a1ffe44e on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:20.981688 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ccfc5910>, '78789faf-e362-4dcb-9299-2450da3fd2ca') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:20.981983 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3ccfc5910>, '78789faf-e362-4dcb-9299-2450da3fd2ca') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:20.984286 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.984878 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.985399 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.985924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.986761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.987087 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.987428 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.987743 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.988068 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.988391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.988738 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.989062 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:20.991843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-af9c750a-dea6-426c-b8b1-df28ec82f203 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:20.994576 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:21.010952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:21.017015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Releasing vlan 90 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:54:21.017435 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:54:21.034282 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:54:21.106039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:21.109602 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:21.126043 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:21.135952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Pushing event deleted for resources: {'Network': ['ID=4fe37e11-4ddd-41fd-b2d4-95525adc3be2,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:21.139070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:21.149536 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-89262f6b-4229-4644-b978-6175f7961b83 admin admin] 10.222.0.22 "DELETE /v2.0/networks/4fe37e11-4ddd-41fd-b2d4-95525adc3be2 HTTP/1.1" status: 204  len: 168 time: 0.8100383
Jun 01 18:54:21.152271 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40106) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:21.765212 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:22.157007 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Deleting port 82e5e970-63b6-46d7-93d8-ac0c6157f271 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:22.157776 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:22.261656 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 961b4c5c-4330-4095-9c49-9264a1ffe44e no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:22.275193 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] For port 82e5e970-63b6-46d7-93d8-ac0c6157f271, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=82e5e970-63b6-46d7-93d8-ac0c6157f271,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:22.275551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:22.298650 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 961b4c5c-4330-4095-9c49-9264a1ffe44e {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:22.299003 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 961b4c5c-4330-4095-9c49-9264a1ffe44e not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:22.400472 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Calling delete_port for 82e5e970-63b6-46d7-93d8-ac0c6157f271 owned by network:router_interface {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:22.540972 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:22.545289 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-65c3dd11-7216-4d94-b0a0-587fa934830e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:22.590653 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Pushing event deleted for resources: {'Port': ['ID=82e5e970-63b6-46d7-93d8-ac0c6157f271,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:22.615950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:22.851001 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:23.221051 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:54:23.291277 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:54:23.463904 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:54:23.475461 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Sync routers for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:54:23.481319 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] 10.222.0.22 "PUT /v2.0/routers/84fe2f5a-8613-4292-8a5b-f08a64655ee3/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3280234
Jun 01 18:54:23.483948 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40116) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:23.492446 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:23.492446 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaecd00>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:23.667397 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks [] for router, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:23.681950 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:23.852821 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:23.928153 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Deleting port e3321a7a-4a12-4fa7-9146-6295949c61eb {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:23.928526 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:23.988618 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaecd00>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252'}], 'enable_snat': True}, 'gw_port_id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:54:22Z', 'revision_number': 5, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port': {'id': 'e3321a7a-4a12-4fa7-9146-6295949c61eb', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:35:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:48:39Z', 'updated_at': '2021-06-01T18:48:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:23.992389 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Checking router: 84fe2f5a-8613-4292-8a5b-f08a64655ee3 for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:54:24.002627 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Routers {'84fe2f5a-8613-4292-8a5b-f08a64655ee3'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:24.003252 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaecd00>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:24.058742 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] For port e3321a7a-4a12-4fa7-9146-6295949c61eb, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e3321a7a-4a12-4fa7-9146-6295949c61eb,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:24.059107 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.186617 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Calling delete_port for e3321a7a-4a12-4fa7-9146-6295949c61eb owned by network:router_gateway {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:24.192540 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] Set router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 gateway port host: None {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:24.316007 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdaecd00>, [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:54:23Z', 'revision_number': 6, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:24.319907 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7795ea67-b51e-4a0c-b645-414e7ad6d15a None None] The sync data for ids ['84fe2f5a-8613-4292-8a5b-f08a64655ee3'] in dv-cinder-794021-1-iscsi is: [{'id': '84fe2f5a-8613-4292-8a5b-f08a64655ee3', 'name': 'tempest-TestShelveInstance-2000933790-router', 'tenant_id': '0b98a000057541b9ab9d7a211142b5ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:48:38Z', 'updated_at': '2021-06-01T18:54:23Z', 'revision_number': 6, 'project_id': '0b98a000057541b9ab9d7a211142b5ee', 'gw_port_host': None}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:54:24.340938 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.347234 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-14d661fd-5581-4de5-815c-8ec9e87e6e9e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:24.393595 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Pushing event deleted for resources: {'Port': ['ID=e3321a7a-4a12-4fa7-9146-6295949c61eb,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:24.424372 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:24.584296 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.755551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.757735 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.779428 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.780073 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 84fe2f5a-8613-4292-8a5b-f08a64655ee3 {{(pid=98259) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:54:24.792435 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.793535 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] 10.222.0.22 "DELETE /v2.0/routers/84fe2f5a-8613-4292-8a5b-f08a64655ee3 HTTP/1.1" status: 204  len: 168 time: 1.3086467
Jun 01 18:54:24.796090 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40148) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:24.852978 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_v2 [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Deleting subnet 0686cff7-f6f6-4087-8dd6-308dec1639ca {{(pid=98259) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:54:24.855746 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.905435 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2552172'] for subnet, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:24.979441 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.227437 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2209705', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3724187'] for subnet, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.232140 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c7a1b8db-6206-4353-800a-7824e29458f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:25.266803 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0686cff7-f6f6-4087-8dd6-308dec1639ca,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:25.269298 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.271855 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:25.273441 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d31c1819-8985-4a08-93f1-f848664d2b64 None None] Network eb77fbe1-d543-4027-9623-8adf5aa5e9aa requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:54:25.276721 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-84b2cec6-d976-4f6f-8edd-967fa1ef5167 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/0686cff7-f6f6-4087-8dd6-308dec1639ca HTTP/1.1" status: 204  len: 168 time: 0.4796407
Jun 01 18:54:25.280070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40150) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:25.407580 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.481183 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Deleting port 5f320236-6957-4373-8e3c-9a9582bf0c23 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:25.481682 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.555642 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] DHCP port deletion for eb77fbe1-d543-4027-9623-8adf5aa5e9aa request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:54:25.592767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] For port 5f320236-6957-4373-8e3c-9a9582bf0c23, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=5f320236-6957-4373-8e3c-9a9582bf0c23,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:25.593134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.623045 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Deleting port 5f320236-6957-4373-8e3c-9a9582bf0c23 {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:25.623477 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.722328 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Calling delete_port for 5f320236-6957-4373-8e3c-9a9582bf0c23 owned by network:dhcp {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:25.725663 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] For port 5f320236-6957-4373-8e3c-9a9582bf0c23, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=5f320236-6957-4373-8e3c-9a9582bf0c23,segment=NetworkSegment(761db241-fddf-4c50-be1c-a1d82b6e4d30),segment_id=761db241-fddf-4c50-be1c-a1d82b6e4d30)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:25.726068 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.777287 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.781040 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-998b3f4b-2911-446e-88df-38d083922a45 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:25.823231 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Pushing event deleted for resources: {'Port': ['ID=5f320236-6957-4373-8e3c-9a9582bf0c23,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:25.826950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:25.829227 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] No DVR routers for this DVR port 5f320236-6957-4373-8e3c-9a9582bf0c23 on host dv-cinder-794021-1-iscsi {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:25.854948 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Calling delete_port for 5f320236-6957-4373-8e3c-9a9582bf0c23 owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:25.897723 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.902322 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-90a43325-d285-480c-a4a2-b5ac82b6803f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:25.945743 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Pushing event deleted for resources: {'Port': ['ID=5f320236-6957-4373-8e3c-9a9582bf0c23,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:25.945995 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.947555 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] No DVR routers for this DVR port 5f320236-6957-4373-8e3c-9a9582bf0c23 on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:25.948921 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-e83f44ea-44e6-4013-ad1c-2fd1e20083f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:25.958679 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd3e8280>,) {'filters': {'network_id': ['eb77fbe1-d543-4027-9623-8adf5aa5e9aa']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:25.970818 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd3e8280>, '761db241-fddf-4c50-be1c-a1d82b6e4d30') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:25.971118 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd3e8280>, '761db241-fddf-4c50-be1c-a1d82b6e4d30') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:25.982395 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:25.998725 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.005726 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Releasing vlan 97 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:54:26.006215 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:54:26.019709 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:54:26.097559 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.102213 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.106067 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:26.128768 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Pushing event deleted for resources: {'Network': ['ID=eb77fbe1-d543-4027-9623-8adf5aa5e9aa,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:26.131018 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:26.132986 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b536e138-e9a3-421e-b54c-3d6001b2a00e admin admin] 10.222.0.22 "DELETE /v2.0/networks/eb77fbe1-d543-4027-9623-8adf5aa5e9aa HTTP/1.1" status: 204  len: 168 time: 0.8517511
Jun 01 18:54:26.273331 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 82e5e970-63b6-46d7-93d8-ac0c6157f271 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:26.309118 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 82e5e970-63b6-46d7-93d8-ac0c6157f271 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:26.309730 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40160) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:26.310113 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 82e5e970-63b6-46d7-93d8-ac0c6157f271 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:26.310113 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 5f320236-6957-4373-8e3c-9a9582bf0c23 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:26.346027 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 5f320236-6957-4373-8e3c-9a9582bf0c23 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:26.346378 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 5f320236-6957-4373-8e3c-9a9582bf0c23 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:26.346796 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e3321a7a-4a12-4fa7-9146-6295949c61eb no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:26.356764 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-151649e0-6f4f-4831-91b6-eadf7714aeff admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=85f17a1d02ae4454a980be1331cbe34d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0460281
Jun 01 18:54:26.359197 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40162) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:26.380611 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: e3321a7a-4a12-4fa7-9146-6295949c61eb {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:26.380991 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e3321a7a-4a12-4fa7-9146-6295949c61eb not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:26.417159 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.443646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.503336 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.507006 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7be4b40c-5e93-493b-9922-c1ad08996d0a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:26.608125 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c3941d5-7f91-4f24-b26e-f38cb957a281,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:26.611456 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:26.616721 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:26.620047 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/9c3941d5-7f91-4f24-b26e-f38cb957a281 HTTP/1.1" status: 204  len: 168 time: 0.2576613
Jun 01 18:54:26.882722 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40174) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:26.973404 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40178) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:27.008226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.034038 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:27.045499 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Usage tracker for resource:security_group_rule and tenant:4a2a9c16b1ac4afcb5197aa0465e2429 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:27.050273 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:27.057807 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-cc78c873-871e-45be-a187-0f0b99a71c86 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=0b98a000057541b9ab9d7a211142b5ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0832348
Jun 01 18:54:27.058695 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:27.060379 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40180) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:27.126258 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.143945 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.147589 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.153473 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.156481 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-dc5187fe-0d84-4473-9080-664aa1aff386 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:27.194749 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=4a2a9c16b1ac4afcb5197aa0465e2429&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3109634
Jun 01 18:54:27.196448 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d2a7345-8e0d-4be5-afae-2847b628ca90,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:27.197645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40182) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:27.199820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:27.215919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.225930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-faea7831-e144-4108-b17c-22ea1c7f7b87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:27.245816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd3e2e82-d2e0-4913-b8c4-e1f4a174b70c,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:27.266835 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.267242 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.267617 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.267984 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.268344 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.268795 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.269155 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.269512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.269868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.270222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.270575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.270926 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:27.273437 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.274795 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/dd3e2e82-d2e0-4913-b8c4-e1f4a174b70c HTTP/1.1" status: 204  len: 168 time: 0.2134156
Jun 01 18:54:27.275864 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:27.298063 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.325142 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.378685 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.384117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-15674c95-acc9-4680-9486-42bf2d3370f4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:27.397160 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d2a7345-8e0d-4be5-afae-2847b628ca90,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:27.399960 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:27.401197 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:27.402476 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a9a8f5d1-ceb5-4868-90fb-200a08723d7e admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/1d2a7345-8e0d-4be5-afae-2847b628ca90 HTTP/1.1" status: 204  len: 168 time: 0.2035928
Jun 01 18:54:30.910081 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b71d720-3ac0-4325-b5cc-c7d32e91ef36 req-42021cf5-c1f6-44a0-b905-4e0f7f7ce38c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:30.911828 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b71d720-3ac0-4325-b5cc-c7d32e91ef36 req-42021cf5-c1f6-44a0-b905-4e0f7f7ce38c tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 946 time: 0.0879326
Jun 01 18:54:30.957539 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b71d720-3ac0-4325-b5cc-c7d32e91ef36 req-c87505fb-c5f2-4af8-ae95-1e017b722aad tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397770
Jun 01 18:54:32.153991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca90d8f-e9fd-429c-b826-029d60cb4ffc req-2f4eade0-d878-4f4d-8466-0fe1877200a4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:32.155440 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-aca90d8f-e9fd-429c-b826-029d60cb4ffc req-2f4eade0-d878-4f4d-8466-0fe1877200a4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 946 time: 0.0835736
Jun 01 18:54:32.205721 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-aca90d8f-e9fd-429c-b826-029d60cb4ffc req-1c304397-c538-42c9-a1a7-477e240e45b0 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups?id=470a6b94-15c0-46f0-a069-d03795944f6d&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434337
Jun 01 18:54:32.318928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-9323eebf-9de8-485a-8b58-0fbe17457055 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:32.320316 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-9323eebf-9de8-485a-8b58-0fbe17457055 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 946 time: 0.0783319
Jun 01 18:54:32.456735 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Deleting port 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:32.457078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:32.672911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] For port 1151ad48-db08-470c-a31f-319eab029862, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1151ad48-db08-470c-a31f-319eab029862,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:32.673291 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:32.955920 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:32.956285 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:32.956624 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Floating IP 3ad8f880-1c80-45af-b178-492b3ca12db8 disassociated. External IP: 172.27.0.124, port: 1151ad48-db08-470c-a31f-319eab029862.
Jun 01 18:54:32.956961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Calling delete_port for 1151ad48-db08-470c-a31f-319eab029862 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:33.064648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:33.070229 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:33.119072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'Port': ['ID=1151ad48-db08-470c-a31f-319eab029862,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:33.123713 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:33.310571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:54:33.364753 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-46d92d3c-9e7c-4cef-8be8-aea53a6f8a67 req-07a5ed6a-8837-4705-b513-bf2e2e56289e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/ports?device_id=3f899fb3-5af3-40b4-a8c8-70083af20337 HTTP/1.1" status: 200  len: 210 time: 0.0423932
Jun 01 18:54:33.514575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:54:33.525423 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:54:33.539686 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:33.540497 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48d90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:33.614958 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] No DVR routers for this DVR port 1151ad48-db08-470c-a31f-319eab029862 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:33.619455 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:33.622389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-deleted', 'tag': '1151ad48-db08-470c-a31f-319eab029862'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:54:33.624783 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6da87b0d-d249-45e1-ae48-0ea41d76e026" -d '{"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-deleted", "tag": "1151ad48-db08-470c-a31f-319eab029862"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:54:33.649509 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-cf7e9d63-d4bd-4923-98c7-c9634306eeee req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.25 "DELETE /v2.0/ports/1151ad48-db08-470c-a31f-319eab029862 HTTP/1.1" status: 204  len: 173 time: 1.3194981
Jun 01 18:54:33.679488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:54:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71d6901f-fe0b-46e9-858c-1fc5006d7be8 x-openstack-request-id: req-71d6901f-fe0b-46e9-858c-1fc5006d7be8 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:54:33.679827 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f899fb3-5af3-40b4-a8c8-70083af20337", "name": "network-vif-deleted", "tag": "1151ad48-db08-470c-a31f-319eab029862", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:54:33.680176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-71d6901f-fe0b-46e9-858c-1fc5006d7be8 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:54:33.680699 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f899fb3-5af3-40b4-a8c8-70083af20337', 'name': 'network-vif-deleted', 'tag': '1151ad48-db08-470c-a31f-319eab029862', 'status': 'completed', 'code': 200}
Jun 01 18:54:33.741278 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:34.052790 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48d90>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:34.056412 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:54:34.064568 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:34.065155 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48d90>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:34.237742 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:34.494363 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40296) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:34.546344 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48d90>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:34.550352 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a74ec6f1-1853-45df-bb37-80fd339dd776 None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:47:32Z', 'revision_number': 4, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed', 'name': '', 'network_id': 'd5efada3-47d7-493b-989f-ef9ac42a4054', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'mac_address': 'fa:16:3e:e5:81:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:29Z', 'updated_at': '2021-06-01T18:47:45Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'subnets': [{'id': '3bc46f81-88af-4aba-902a-90b4633edf6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:54:34.561484 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:34.590521 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:34.646652 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:34.650951 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8fccafd0-21c4-4132-8e4c-362b3d902c3e tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:34.669964 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=470a6b94-15c0-46f0-a069-d03795944f6d,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:34.679379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.679763 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.680144 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.680542 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.680911 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.681278 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.681638 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.681989 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.682354 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.682717 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.683069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.683425 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:54:34.687984 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:34.695347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:34.696717 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "DELETE /v2.0/security-groups/470a6b94-15c0-46f0-a069-d03795944f6d HTTP/1.1" status: 204  len: 168 time: 0.2012777
Jun 01 18:54:34.699665 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40302) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:34.726255 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.api.v2.resource [None req-0dd44c7f-a48d-4f24-b4e6-347b6a7339d9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] show failed (client error): The resource could not be found.
Jun 01 18:54:34.730510 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-0dd44c7f-a48d-4f24-b4e6-347b6a7339d9 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "GET /v2.0/security-groups/470a6b94-15c0-46f0-a069-d03795944f6d HTTP/1.1" status: 404  len: 347 time: 0.0280018
Jun 01 18:54:34.730750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40304) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:34.817082 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8db1b243-120c-4cd9-9b05-fc94bce7f0b7 None None] New status for floating IP 3ad8f880-1c80-45af-b178-492b3ca12db8: DOWN {{(pid=98260) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:54:34.963385 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Deleting port 47fc06fd-f38d-4605-bb89-0ec730261dda {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:34.963807 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.089121 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.089450 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.325010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Calling delete_port for 47fc06fd-f38d-4605-bb89-0ec730261dda owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:35.433936 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.437460 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-616c653a-b1ab-4f06-a361-3b1e74d62ba4 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:35.479858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Pushing event deleted for resources: {'Port': ['ID=47fc06fd-f38d-4605-bb89-0ec730261dda,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:35.483386 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:35.572922 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.586443 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:35.587575 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a2178ea3-8c5b-4942-a3a6-a9e723162118 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] 10.222.0.22 "DELETE /v2.0/floatingips/3ad8f880-1c80-45af-b178-492b3ca12db8 HTTP/1.1" status: 204  len: 168 time: 0.8558936
Jun 01 18:54:36.544488 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:36.582475 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 1151ad48-db08-470c-a31f-319eab029862 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:36.582827 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 1151ad48-db08-470c-a31f-319eab029862 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:36.664195 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40334) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:36.780241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:36.794636 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:36.798980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Usage tracker for resource:security_group_rule and tenant:d4a6bd6259ee4a30afe2d6a22fd63a88 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:36.801802 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:36.807524 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:36.894208 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:36.897799 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:36.905423 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d9502f0a-b2dc-4378-9cd5-2ea4ab06d568 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:36.950116 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=d4a6bd6259ee4a30afe2d6a22fd63a88&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2848189
Jun 01 18:54:36.951035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=499874df-6a45-402d-895b-1662b3697487,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:36.952858 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40344) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:36.955258 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3e6c045a-1776-4dd7-ac32-cf2e543e8e9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:37.010448 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.037301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.094232 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.100034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c69b766e-9fc1-4440-947d-508d1474f9e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:37.114281 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=499874df-6a45-402d-895b-1662b3697487,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:37.117462 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:37.120337 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.121500 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-f6687f64-e8b4-4798-833b-b3073daa37f0 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/499874df-6a45-402d-895b-1662b3697487 HTTP/1.1" status: 204  len: 168 time: 0.1675782
Jun 01 18:54:37.420961 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40354) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:37.437621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.451991 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:37.456388 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Usage tracker for resource:security_group_rule and tenant:f12a5f83e3ec4d4787b1d26e4b9835a2 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:37.459766 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:37.465415 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:37.479145 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-20dd3d12-63a1-4ec9-81b3-12b386611dea service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0719800
Jun 01 18:54:37.547205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.551134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.559689 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-25d2ac40-fef5-4b53-a975-53d00ab0dac3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:37.577980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-cac957f6-b173-444a-bec3-c73c6b6b8010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:37.579963 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-cac957f6-b173-444a-bec3-c73c6b6b8010 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 1099 time: 0.0732479
Jun 01 18:54:37.598612 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=f12a5f83e3ec4d4787b1d26e4b9835a2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1764915
Jun 01 18:54:37.600336 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34c11e69-ba48-43e9-8290-65edb8d5fcf7,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:37.601283 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40356) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:37.603156 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2751fd09-1bf6-415e-9d2d-ae0cd6b13ffd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:37.761547 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.797558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-bfd1f506-ed9c-4556-ba4a-2ce5fd9fa985 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:37.798951 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-bfd1f506-ed9c-4556-ba4a-2ce5fd9fa985 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1832213
Jun 01 18:54:37.803005 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.927177 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-93318324-52fe-4c74-a010-05add2ababd2 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 200  len: 1002 time: 0.1178191
Jun 01 18:54:37.972017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:37.980032 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a36d25a-7227-4386-a74f-6144b1784551 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:37.994129 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34c11e69-ba48-43e9-8290-65edb8d5fcf7,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:37.996867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:38.016618 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:38.018397 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/34c11e69-ba48-43e9-8290-65edb8d5fcf7 HTTP/1.1" status: 204  len: 168 time: 0.4160774
Jun 01 18:54:38.025108 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-5767cf6c-8dd2-4a8e-b7fc-6aec7705f1ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:38.026586 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-5767cf6c-8dd2-4a8e-b7fc-6aec7705f1ed service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0892007
Jun 01 18:54:38.108897 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-f6b09aca-8163-4d33-b676-c1ba9febda04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:54:38.110373 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-f6b09aca-8163-4d33-b676-c1ba9febda04 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0738099
Jun 01 18:54:38.253653 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-beefbfbe-6523-4564-97ad-a23c6effde9d service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1331165
Jun 01 18:54:38.380612 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40368) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:38.382835 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40370) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:38.407946 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:38.423751 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-970f7e55-1d86-4f9a-a39b-a83936b17a75 req-1302e5b9-6589-4dcd-b144-7933e4cffd9f service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1583662
Jun 01 18:54:38.427239 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:38.432094 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Usage tracker for resource:security_group_rule and tenant:e27fd715888546feac1bfefba767c8e5 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:38.434959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:38.442146 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:38.527107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:38.531018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:38.540050 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0fc3aefd-e56e-4264-a546-0826b20b287b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:38.583913 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=e27fd715888546feac1bfefba767c8e5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2022092
Jun 01 18:54:38.584983 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3106594e-5d16-4815-9d64-32b9b063f58e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:38.586554 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40374) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:38.590042 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-158eaf1d-7154-4e47-b29b-782ca44311df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:38.778211 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:38.827880 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:39.022018 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:39.028509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-45d3e045-36ca-4e74-87ce-a21e45424032 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:39.047146 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3106594e-5d16-4815-9d64-32b9b063f58e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:39.080202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:39.093374 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:39.094476 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-3ad4d06f-136c-4b2b-9b97-fe57c245e269 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/3106594e-5d16-4815-9d64-32b9b063f58e HTTP/1.1" status: 204  len: 168 time: 0.5068164
Jun 01 18:54:39.249445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:39.759762 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Deleting port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:39.760942 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:39.891344 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] For port 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:39.891699 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:40.013074 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Calling delete_port for 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed owned by network:router_interface {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:40.162488 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:40.167058 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6a05d5c5-f57d-4b92-a286-a65c23ddcdce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:40.209175 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Pushing event deleted for resources: {'Port': ['ID=7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:40.211629 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:40.496125 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:40.822506 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:40.856982 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Router 30c62078-57a9-4e7d-a9a5-da5b56adb64d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:54:41.140893 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:54:41.150071 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Sync routers for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:54:41.153510 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-6579a502-4ff7-41be-b5bf-96195392244c admin admin] 10.222.0.22 "PUT /v2.0/routers/30c62078-57a9-4e7d-a9a5-da5b56adb64d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7695572
Jun 01 18:54:41.155966 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40456) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:41.159145 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:41.159755 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48c40>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:41.331678 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks [] for router, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:41.340341 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:41.507775 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:41.589759 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Deleting port e200a8c1-5a59-4731-bd93-51b68c3c45d6 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:41.590347 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:41.666973 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48c40>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202'}], 'enable_snat': True}, 'gw_port_id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:54:40Z', 'revision_number': 5, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port': {'id': 'e200a8c1-5a59-4731-bd93-51b68c3c45d6', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:cf:46:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.202', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:47:18Z', 'updated_at': '2021-06-01T18:47:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:41.671899 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Checking router: 30c62078-57a9-4e7d-a9a5-da5b56adb64d for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:54:41.681299 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Routers {'30c62078-57a9-4e7d-a9a5-da5b56adb64d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:54:41.681917 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48c40>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:54:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:41.723434 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] For port e200a8c1-5a59-4731-bd93-51b68c3c45d6, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=e200a8c1-5a59-4731-bd93-51b68c3c45d6,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:41.723793 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:41.828566 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] Set router 30c62078-57a9-4e7d-a9a5-da5b56adb64d gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:54:41.851862 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Calling delete_port for e200a8c1-5a59-4731-bd93-51b68c3c45d6 owned by network:router_gateway {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:41.932545 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdd48c40>, [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:54:41Z', 'revision_number': 6, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:41.936389 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b32f8077-6ea8-418d-be1a-2e2a4c7fcd3c None None] The sync data for ids ['30c62078-57a9-4e7d-a9a5-da5b56adb64d'] in dv-cinder-794021-1-iscsi is: [{'id': '30c62078-57a9-4e7d-a9a5-da5b56adb64d', 'name': 'tempest-AttachVolumeShelveTestJSON-1355374708-router', 'tenant_id': '41638d3f0658425aa2f15362df9748a1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:47:15Z', 'updated_at': '2021-06-01T18:54:41Z', 'revision_number': 6, 'project_id': '41638d3f0658425aa2f15362df9748a1', 'gw_port_host': None}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:54:41.996628 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.000039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5d328d35-80f6-4e89-9dc5-25f536838300 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:42.043706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Pushing event deleted for resources: {'Port': ['ID=e200a8c1-5a59-4731-bd93-51b68c3c45d6,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:42.046803 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:42.135150 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.307444 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.309836 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.337800 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.339235 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 30c62078-57a9-4e7d-a9a5-da5b56adb64d {{(pid=98259) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 18:54:42.354925 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Notify callbacks [] for router, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.355248 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:42.356121 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] 10.222.0.22 "DELETE /v2.0/routers/30c62078-57a9-4e7d-a9a5-da5b56adb64d HTTP/1.1" status: 204  len: 168 time: 1.1991196
Jun 01 18:54:42.360573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40460) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:42.392410 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:42.392825 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7b2f28ed-f8c8-43bf-bfb0-99cd1f1529ed not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:42.428935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Deleting subnet 3bc46f81-88af-4aba-902a-90b4633edf6a {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:54:42.431800 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.479815 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.560123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.909084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.913647 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7518f274-2d4c-4e12-9e02-18584fedb8f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:42.956488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3bc46f81-88af-4aba-902a-90b4633edf6a,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:42.958474 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:42.963392 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d7c2d87-4295-494e-975b-d33c3f1c5219 None None] Network d5efada3-47d7-493b-989f-ef9ac42a4054 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:54:42.967023 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:42.969555 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-5183d62f-9cfb-4029-8c9d-aa463fdca8dc admin admin] 10.222.0.22 "DELETE /v2.0/subnets/3bc46f81-88af-4aba-902a-90b4633edf6a HTTP/1.1" status: 204  len: 168 time: 0.6080952
Jun 01 18:54:42.972258 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40464) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:43.184847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.258760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Deleting port 3b3ca2a3-d92a-46d5-b858-10549997d96e {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:43.258760 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.263574 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] DHCP port deletion for d5efada3-47d7-493b-989f-ef9ac42a4054 request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 18:54:43.328162 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Deleting port 3b3ca2a3-d92a-46d5-b858-10549997d96e {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:54:43.328572 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.357645 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] For port 3b3ca2a3-d92a-46d5-b858-10549997d96e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=3b3ca2a3-d92a-46d5-b858-10549997d96e,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:43.358000 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.425466 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] For port 3b3ca2a3-d92a-46d5-b858-10549997d96e, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=3b3ca2a3-d92a-46d5-b858-10549997d96e,segment=NetworkSegment(13fe2f88-2641-4a98-bd4a-51b0be7341a1),segment_id=13fe2f88-2641-4a98-bd4a-51b0be7341a1)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:54:43.426087 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.485168 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Calling delete_port for 3b3ca2a3-d92a-46d5-b858-10549997d96e owned by network:dhcp {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:43.534139 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.537905 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a96e3791-9ed7-4b60-9e7c-7a03a3ca00ce tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:43.546747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Calling delete_port for 3b3ca2a3-d92a-46d5-b858-10549997d96e owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:54:43.584474 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Pushing event deleted for resources: {'Port': ['ID=3b3ca2a3-d92a-46d5-b858-10549997d96e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:43.587539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:43.588312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] No DVR routers for this DVR port 3b3ca2a3-d92a-46d5-b858-10549997d96e on host dv-cinder-794021-1-iscsi {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:43.594708 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.598939 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:43.643501 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Pushing event deleted for resources: {'Port': ['ID=3b3ca2a3-d92a-46d5-b858-10549997d96e,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:43.646469 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:43.647275 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2fccf1c-0419-484b-9c3d-9e6ea9d75601 None None] No DVR routers for this DVR port 3b3ca2a3-d92a-46d5-b858-10549997d96e on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:54:43.702384 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.714878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3c7d77d90>,) {'filters': {'network_id': ['d5efada3-47d7-493b-989f-ef9ac42a4054']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:43.728265 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7d77d90>, '13fe2f88-2641-4a98-bd4a-51b0be7341a1') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:43.728588 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7d77d90>, '13fe2f88-2641-4a98-bd4a-51b0be7341a1') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:54:43.741361 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.758325 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.764854 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Releasing vlan 58 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:54:43.765243 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:54:43.779991 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:54:43.862138 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.865700 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c386be2a-418e-49ff-888b-65a99c6bc4e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:43.879406 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:43.889539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Pushing event deleted for resources: {'Network': ['ID=d5efada3-47d7-493b-989f-ef9ac42a4054,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:43.893288 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:43.902978 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] 10.222.0.22 "DELETE /v2.0/networks/d5efada3-47d7-493b-989f-ef9ac42a4054 HTTP/1.1" status: 204  len: 168 time: 0.9296868
Jun 01 18:54:44.075451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40470) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:44.124915 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-796df6af-ac2f-4de3-8722-985d977923bb admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=41638d3f0658425aa2f15362df9748a1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0480897
Jun 01 18:54:44.127648 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40472) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:44.143957 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3246b0ec-0615-4088-9c2e-576a88d28362 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:44.187039 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:44.212005 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:44.264477 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:44.268492 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-236deba1-7e11-47cf-88ae-b65403fe2927 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:44.277686 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e200a8c1-5a59-4731-bd93-51b68c3c45d6 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:44.287031 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=062b617c-2172-441b-93f2-e7c070ec6f65,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:44.290793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:44.294024 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:44.295130 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/062b617c-2172-441b-93f2-e7c070ec6f65 HTTP/1.1" status: 204  len: 168 time: 0.1665926
Jun 01 18:54:44.323924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: e200a8c1-5a59-4731-bd93-51b68c3c45d6 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:44.324275 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device e200a8c1-5a59-4731-bd93-51b68c3c45d6 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:44.324721 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 3b3ca2a3-d92a-46d5-b858-10549997d96e no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:54:44.357988 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 3b3ca2a3-d92a-46d5-b858-10549997d96e {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:54:44.358340 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 3b3ca2a3-d92a-46d5-b858-10549997d96e not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:54:46.724349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8b71cb4c-0524-49d0-9754-cdd8362fa392 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:46.873717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:47.820637 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.440760 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40540) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:48.555564 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.569663 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:54:48.573760 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Usage tracker for resource:security_group_rule and tenant:b4107e9a35924e26aad7d2f6cbad225c is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:54:48.576611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:54:48.582228 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:54:48.665916 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.669907 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.679145 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-77c95415-d5ed-409f-8f63-0ca8d3bc6d37 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:48.723171 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=b4107e9a35924e26aad7d2f6cbad225c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2813144
Jun 01 18:54:48.724766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=742b7ec5-c241-4f6f-9bae-aa2abc7351f4,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:48.725914 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40544) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:54:48.727952 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:48.785053 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.818213 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.870026 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.873583 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-980b53ce-2042-4ab0-833a-4628678fa775 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:54:48.885810 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=742b7ec5-c241-4f6f-9bae-aa2abc7351f4,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:54:48.888660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:54:48.890546 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:54:48.892135 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/742b7ec5-c241-4f6f-9bae-aa2abc7351f4 HTTP/1.1" status: 204  len: 168 time: 0.1647410
Jun 01 18:54:49.526959 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:00.219977 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:55:01.750551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40724) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:01.871045 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:01.889333 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:01.893299 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Usage tracker for resource:security_group_rule and tenant:18f7872b61de44d685a9923e14fd34b4 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:01.896065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:01.902378 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:01.983231 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:01.987109 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:01.995153 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d8560a82-bed5-4b49-b660-a66bd9a7b303 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:02.033415 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=18f7872b61de44d685a9923e14fd34b4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2816737
Jun 01 18:55:02.034923 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b7cbdc0-8822-4f29-8ccb-f592e3af662d,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:02.036059 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40728) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:02.037948 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-caf29a4d-7f85-457b-91e2-dace2423a68f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:02.093273 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.117425 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.170821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.174783 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9face9b8-20e3-489a-a3fd-284a6accb273 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:02.186898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b7cbdc0-8822-4f29-8ccb-f592e3af662d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:02.189879 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:02.197163 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.198275 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/3b7cbdc0-8822-4f29-8ccb-f592e3af662d HTTP/1.1" status: 204  len: 168 time: 0.1611929
Jun 01 18:55:02.466174 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40734) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:02.483547 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.497450 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:02.501175 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Usage tracker for resource:security_group_rule and tenant:64201f1ef4bf4208acee93a22003ce26 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:02.504443 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:02.510080 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:02.596611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.600222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.608589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6cee58a1-6f78-4c9c-ab99-5d9b405e6c1a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:02.646895 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=64201f1ef4bf4208acee93a22003ce26&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1796961
Jun 01 18:55:02.648462 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b28db0fe-e91d-4b00-8fc7-5b8e368abe9e,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:02.649878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40736) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:02.651617 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-07b0163e-2bb3-455f-917b-874afb466fb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:02.709905 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.737522 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.791538 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.797191 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b91e6b42-0d13-4f88-b22d-3c40a09d2b70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:02.810539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b28db0fe-e91d-4b00-8fc7-5b8e368abe9e,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:02.813348 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:02.820822 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:02.822863 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-b3cc192b-9fc4-41f2-9db5-022058d5ff86 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/b28db0fe-e91d-4b00-8fc7-5b8e368abe9e HTTP/1.1" status: 204  len: 168 time: 0.1710727
Jun 01 18:55:08.678177 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40828) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:08.803054 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:08.817440 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:08.821165 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Usage tracker for resource:security_group_rule and tenant:bc8cb1c13cae470cab8ca2aef426bada is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:08.823881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:08.830067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:08.921624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:08.926035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:08.932980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a9784ca0-96b2-4863-b13f-3379a4d463c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:08.973113 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=bc8cb1c13cae470cab8ca2aef426bada&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2938673
Jun 01 18:55:08.974017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0c7a9c2-4b62-43c9-941b-988bbb231947,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:08.976038 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40836) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:08.977287 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:09.036488 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.061611 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.114034 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.117706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-fe3c1885-3b64-4c13-865a-7e80081b8915 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:09.128987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0c7a9c2-4b62-43c9-941b-988bbb231947,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:09.132806 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:09.136188 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.137108 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-2c2173cc-2178-4559-95ea-67d62b6dafc1 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/e0c7a9c2-4b62-43c9-941b-988bbb231947 HTTP/1.1" status: 204  len: 168 time: 0.1591926
Jun 01 18:55:09.419288 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40846) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:09.436581 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.450353 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:09.454088 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Usage tracker for resource:security_group_rule and tenant:92ed092227604d358b42597a452db95b is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:09.456864 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:09.462398 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:09.543069 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.547142 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.559671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-07ad2912-8c8d-41cf-abcc-33fbef4affac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:09.597239 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32e4ca2e-8630-44bc-898b-36efba793dcc,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:09.603707 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=92ed092227604d358b42597a452db95b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1810768
Jun 01 18:55:09.603707 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7994e999-5360-4c19-b7e1-817ee62c4692 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:09.604793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40848) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:09.661286 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.686302 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.739106 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.744235 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-9e8e8c7d-8617-469b-bcfc-36a201194075 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:09.758280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32e4ca2e-8630-44bc-898b-36efba793dcc,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:09.760360 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:09.770451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:09.771666 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-fb01b772-6f20-4b0e-999f-e287632699af admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/32e4ca2e-8630-44bc-898b-36efba793dcc HTTP/1.1" status: 204  len: 168 time: 0.1665094
Jun 01 18:55:10.813989 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.504944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40906) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:11.620206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.634399 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:11.638066 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Usage tracker for resource:security_group_rule and tenant:1c2bc325e746456794f9a2bd75afd998 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:11.640787 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:11.646943 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:11.728208 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.731683 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.739940 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ccc2cd3a-14b1-43ed-a78e-c3fee5a15079 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:11.779406 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=1c2bc325e746456794f9a2bd75afd998&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2733951
Jun 01 18:55:11.781215 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a02935af-6923-48bf-8d4b-ce3d03a3ba2d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:11.782021 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40910) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:11.784574 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8cd8d2e9-8960-491a-9374-1eb479bed5b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:11.843697 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.868274 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.919561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.923573 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-15d15df3-fe2e-4350-bbef-340e7d85b105 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:11.934986 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a02935af-6923-48bf-8d4b-ce3d03a3ba2d,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:11.938011 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:11.945293 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:11.948455 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-0445165c-74c2-4a84-ade3-66f522e06b8f admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/a02935af-6923-48bf-8d4b-ce3d03a3ba2d HTTP/1.1" status: 204  len: 168 time: 0.1633015
Jun 01 18:55:12.214702 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 40916) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:12.231489 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.245728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:12.249472 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Usage tracker for resource:security_group_rule and tenant:8466d4d1158b40628a5c1a6f2dc85e88 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:12.252263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:12.257888 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:12.336982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.340616 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.349447 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e34013b1-049d-4d68-a05f-b9d248c611c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:12.390405 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=8466d4d1158b40628a5c1a6f2dc85e88&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1746497
Jun 01 18:55:12.391959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9420cee6-3836-4312-af45-ccf915b256f1,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:12.393065 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 40918) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:12.394881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-711f53e1-df04-4c95-9bce-29bde49167c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:12.453245 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.478510 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.530706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.535099 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7a52597c-1793-423a-a47a-7fd9f1739f54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:12.546196 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9420cee6-3836-4312-af45-ccf915b256f1,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:12.552564 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:12.553349 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:12.557091 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-5bf30462-b7f9-497a-be92-9b3473f318d0 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/9420cee6-3836-4312-af45-ccf915b256f1 HTTP/1.1" status: 204  len: 168 time: 0.1629868
Jun 01 18:55:14.142430 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-350406a2-f4d3-4203-a8da-7e0b1635b7b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.087717 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41002) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:15.206253 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.219950 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:15.223690 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Usage tracker for resource:security_group_rule and tenant:604e3ee4a81d4f0abdcf73198bf62268 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:15.226463 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:15.232076 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:15.316916 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.320519 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.328583 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bd6ab5c7-73d7-443b-b062-da8dd457a81f tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:15.367669 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=604e3ee4a81d4f0abdcf73198bf62268&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2786603
Jun 01 18:55:15.369770 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ac46c8c-6456-4184-b3c6-9fe423d1bca3,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:15.370563 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41008) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:15.372140 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-05504bac-da70-46b7-856d-9c8951efba83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:15.429088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.453501 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.503810 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.508472 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8826c169-5bbd-49b7-8d74-4f0532907653 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:15.521858 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ac46c8c-6456-4184-b3c6-9fe423d1bca3,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:15.524073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:15.534278 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.535692 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-dc7a6771-196f-429f-ae73-60bb99b29a82 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/3ac46c8c-6456-4184-b3c6-9fe423d1bca3 HTTP/1.1" status: 204  len: 168 time: 0.1634910
Jun 01 18:55:15.806457 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41014) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:15.823749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.837376 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:15.841080 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Usage tracker for resource:security_group_rule and tenant:ec90d53d4a32463e952777a5c195fd35 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:15.843758 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:15.849398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:15.927868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.931457 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:15.943666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ffb07d86-d123-42a3-9ac1-2ed4638d74d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:15.981495 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ec90d53d4a32463e952777a5c195fd35&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1740260
Jun 01 18:55:15.982381 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e12f1197-1669-4a88-972d-80eebb721162,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:15.984268 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41016) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:15.985280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-12965377-1ebe-4fa0-a3d0-8337700b49e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:16.045201 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:16.070094 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:16.120626 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:16.124036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-59668583-c502-4e40-a6ee-44da195ab737 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:16.136323 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e12f1197-1669-4a88-972d-80eebb721162,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:16.138591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:16.148531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:16.149892 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-527a8a3d-a2e5-4d70-bbc9-26d43a66f84e admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/e12f1197-1669-4a88-972d-80eebb721162 HTTP/1.1" status: 204  len: 168 time: 0.1645768
Jun 01 18:55:16.726422 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-64ee365c-e172-4a80-8c6d-49e61d2d9d6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:16.868199 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:17.824082 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:18.962107 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41080) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:19.085508 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.101571 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:19.105653 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Usage tracker for resource:security_group_rule and tenant:56a016c598554335af2f3a8278bd8e75 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:19.108531 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:19.114385 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:19.199439 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.203285 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.212489 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-448ebefb-e496-4ddb-9c17-49d7e19118a9 tempest-AttachVolumeTestJSON-564196127 tempest-AttachVolumeTestJSON-564196127-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:19.258281 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=56a016c598554335af2f3a8278bd8e75&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2950747
Jun 01 18:55:19.259314 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cb8d670-9833-48ab-b528-fe838d17c44d,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:19.260942 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41092) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:19.262426 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-497f9b33-fd9a-4671-839d-9500eec6f6ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:19.319937 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.356567 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.411684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.416505 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-34b3b406-7da0-4cb8-bcd4-252dca66d4cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:19.428652 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cb8d670-9833-48ab-b528-fe838d17c44d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:19.432465 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:19.437770 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:19.441490 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/2cb8d670-9833-48ab-b528-fe838d17c44d HTTP/1.1" status: 204  len: 168 time: 0.1771646
Jun 01 18:55:19.540768 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.094615 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41120) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:20.196473 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1261302175-network', 'tenant_id': '6606e2f3c3034216a3ea2e1102480063'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:20.201115 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:20.204861 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Usage tracker for resource:network and tenant:6606e2f3c3034216a3ea2e1102480063 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:20.207618 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:20.213908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:20.223319 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Made reservation on behalf of 6606e2f3c3034216a3ea2e1102480063 for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:20.225503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.237538 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.255339 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:20.259035 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Usage tracker for resource:security_group_rule and tenant:6606e2f3c3034216a3ea2e1102480063 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:20.261766 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:20.267418 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:20.347280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.350665 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.354370 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f6641ff2-ed35-4dbc-8b95-a4e0248710c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:20.376315 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] vlan segment allocate from pool success with {'vlan_id': 75, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:55:20.388128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac5c48af-8e37-4bce-864e-17101cdd6bb3,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:20.392761 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:20.393668 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.394004 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Added segment 1856cdc6-6697-441f-a6f2-d3fc325137dc of type vlan for network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb
Jun 01 18:55:20.419417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.446949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.448365 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:20.448986 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.453824 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-78867074-44fe-47d4-aa0f-6289c4b498b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:20.551594 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.4558725
Jun 01 18:55:20.554445 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41124) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:20.556915 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Pushing event updated for resources: {'Network': ['ID=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:20.559571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a543ea0d-8cec-4552-a85b-d602a85697af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:20.560699 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Request body: {'subnet': {'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1261302175-subnet', 'tenant_id': '6606e2f3c3034216a3ea2e1102480063', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:20.566837 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:20.568154 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:55:20.570822 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Usage tracker for resource:subnet and tenant:6606e2f3c3034216a3ea2e1102480063 is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:20.573674 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:20.579895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:20.691050 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Made reservation on behalf of 6606e2f3c3034216a3ea2e1102480063 for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:20.693452 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3724192'] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.854769 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41132) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:20.972992 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:20.988310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:20.992826 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Usage tracker for resource:security_group_rule and tenant:ca199f93229246f3afc73cc5186b2878 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:20.995721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:21.001687 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:21.070634 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2209766', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3724178'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.075186 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a4d806d3-0351-4214-a838-7a1885381114 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:21.085027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.088819 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.096038 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-db3c0c84-6f9a-40ff-9bcd-d188fafc4dcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:21.135046 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=210aa2ae-8db9-4b0b-bfcc-df050505f98d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:21.141840 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=ca199f93229246f3afc73cc5186b2878&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2835732
Jun 01 18:55:21.141840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8c56385b-dbbd-4c2b-a5de-88a46f23bb64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:21.142123 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41136) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:21.148559 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a05ac98a-6bf9-4f53-908b-71fcdd651ada,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:21.152626 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:21.156667 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Checking segment: {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:21.157423 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Network hostable DHCP agents. Network: 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:55:21.174478 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:55:21.183828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:21.194556 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f0992c7-23b3-4d1c-8ea2-d3851ff1f0fc None None] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:55:21.195987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:21.197041 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.203705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.230908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.240939 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-04415a6b-4a3d-4deb-b66c-3553e97de806 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6854091
Jun 01 18:55:21.294211 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.299124 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d733257e-b5f8-43bf-a94c-060e5a4ff6cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:21.309640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=210aa2ae-8db9-4b0b-bfcc-df050505f98d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:21.320649 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:21.322700 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:21.326102 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/210aa2ae-8db9-4b0b-bfcc-df050505f98d HTTP/1.1" status: 204  len: 168 time: 0.1808729
Jun 01 18:55:21.402945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec451611-8dab-45f5-8df6-211e3b5ab42e None None] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:55:22.021791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41168) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:22.128062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-702554898-network', 'tenant_id': '34d11de3d1ac487f94f3c3470921262e'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:22.132733 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:22.136503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Usage tracker for resource:network and tenant:34d11de3d1ac487f94f3c3470921262e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:22.139341 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:22.145589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:22.156130 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Made reservation on behalf of 34d11de3d1ac487f94f3c3470921262e for: {'network': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:22.158543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1034546'] for network, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.170285 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.184113 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:22.187872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Usage tracker for resource:security_group_rule and tenant:34d11de3d1ac487f94f3c3470921262e is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:22.191171 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:22.197075 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:22.276948 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.280675 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.284772 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-be7db388-0062-4498-ab5e-259278250d43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:22.311831 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] vlan segment allocate from pool success with {'vlan_id': 93, 'physical_network': 'physnet1'}  {{(pid=98258) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 18:55:22.325417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:22.329598 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:22.332108 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.332475 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.segments_db [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Added segment b468d7ce-aba1-4f29-a82c-41a02585c79c of type vlan for network 65e659a7-3525-4957-828a-0336c8c79517
Jun 01 18:55:22.357809 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792820236346'] for network, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.387111 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635'] for network, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.388512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:22.389086 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.394230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:22.570835 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] 10.222.0.22 "POST /v2.0/networks HTTP/1.1" status: 201  len: 880 time: 0.5477648
Jun 01 18:55:22.573623 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41172) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:22.576070 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Pushing event updated for resources: {'Network': ['ID=65e659a7-3525-4957-828a-0336c8c79517,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:22.578620 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Request body: {'subnet': {'network_id': '65e659a7-3525-4957-828a-0336c8c79517', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-702554898-subnet', 'tenant_id': '34d11de3d1ac487f94f3c3470921262e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:22.578768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-580a98d6-fba1-40a5-a2bb-fb99bc54c37d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:22.583495 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:22.587033 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Network 65e659a7-3525-4957-828a-0336c8c79517 details requested by agent ovs-agent-dv-cinder-794021-1-iscsi with host dv-cinder-794021-1-iscsi {{(pid=98260) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 18:55:22.587485 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Usage tracker for resource:subnet and tenant:34d11de3d1ac487f94f3c3470921262e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:22.590376 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:22.596208 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:22.606456 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Made reservation on behalf of 34d11de3d1ac487f94f3c3470921262e for: {'subnet': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:22.608842 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3724192'] for subnet, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.988952 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2209766', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3724178'] for subnet, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:22.993384 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-d72fedc6-eea7-4220-8a6a-f397a8c90860 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:23.066276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b7838170-f75b-4303-992d-737ef73a33bc,revision_number=0']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:23.068442 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Checking segment: {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:23.068815 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Network hostable DHCP agents. Network: 65e659a7-3525-4957-828a-0336c8c79517, hostable agents: ['c9330c1a-2500-4122-9d56-fd8944962bab'], hosted agents: [] {{(pid=98259) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 18:55:23.071539 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:23.086713 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Network 65e659a7-3525-4957-828a-0336c8c79517 is scheduled to be hosted by DHCP agent c9330c1a-2500-4122-9d56-fd8944962bab with binding_index 1 {{(pid=98259) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 18:55:23.096754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-1-iscsi, 65e659a7-3525-4957-828a-0336c8c79517) {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:23.105875 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:23.106458 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:23.107473 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6b8ffb6-617c-4aee-8ac5-68271c5ee385 None None] Network 65e659a7-3525-4957-828a-0336c8c79517 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:55:23.127753 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-8c2d1452-7339-41d9-ba5a-76a574b3c8b2 admin admin] 10.222.0.22 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5528681
Jun 01 18:55:23.316204 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75bf13f7-3851-4bac-bcdd-7752c379dd08 None None] Network 65e659a7-3525-4957-828a-0336c8c79517 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 18:55:23.474869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-9a870b7a-33a1-4a1e-ba53-e646d47dd9f9 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:23.475640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-152a9e3a-666f-476a-817f-133aab076c2b req-9a870b7a-33a1-4a1e-ba53-e646d47dd9f9 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Synchronizing usage tracker for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:network {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:23.492586 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-152a9e3a-666f-476a-817f-133aab076c2b req-9a870b7a-33a1-4a1e-ba53-e646d47dd9f9 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Unset dirty status for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:network {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:23.493779 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-9a870b7a-33a1-4a1e-ba53-e646d47dd9f9 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 814 time: 0.1670072
Jun 01 18:55:23.509044 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-29b1c512-4680-49a2-9798-c9a84e296d65 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/quotas/6606e2f3c3034216a3ea2e1102480063 HTTP/1.1" status: 200  len: 375 time: 0.0098350
Jun 01 18:55:23.558754 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-3011494d-b87a-4658-b155-fba0b091abfa tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0429087
Jun 01 18:55:23.763215 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-b7a0e4e3-a880-4427-818d-5456879cd4e0 service neutron] 10.222.0.22 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1974361
Jun 01 18:55:23.899733 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-9d289c8f-e3f4-4919-a5b6-24166d5edb8f service neutron] 10.222.0.22 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1298707
Jun 01 18:55:25.093784 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-991dd402-968a-48e5-b05b-ff139dddd372 req-6388af8a-5287-4e84-a168-29f8b6993395 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 210 time: 0.0463085
Jun 01 18:55:25.269818 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-46d2e1cf-3cc9-40e1-8ee1-a54b77e2cb01 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:25.270412 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-46d2e1cf-3cc9-40e1-8ee1-a54b77e2cb01 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Synchronizing usage tracker for tenant:34d11de3d1ac487f94f3c3470921262e on resource:network {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:25.288247 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-46d2e1cf-3cc9-40e1-8ee1-a54b77e2cb01 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Unset dirty status for tenant:34d11de3d1ac487f94f3c3470921262e on resource:network {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:25.292865 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-46d2e1cf-3cc9-40e1-8ee1-a54b77e2cb01 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 808 time: 0.1653607
Jun 01 18:55:25.304244 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-10a83c2b-757c-4623-ba75-50dbf40a7edb tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/quotas/34d11de3d1ac487f94f3c3470921262e HTTP/1.1" status: 200  len: 375 time: 0.0094090
Jun 01 18:55:25.353285 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-6f82b4bd-929c-4b48-95bc-862e246b5cfc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0441442
Jun 01 18:55:25.483825 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-4f60bac7-53e6-426a-8ef1-f5e4790d41d4 service neutron] 10.222.0.22 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1239946
Jun 01 18:55:25.610189 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-aac75235-d790-4fc5-8869-2eea0bfc67a5 service neutron] 10.222.0.22 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1204593
Jun 01 18:55:25.783618 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-08bb35e3-8a05-4b43-9ebc-cf2c67060555 req-8238aa0d-2ccd-45a9-b9d5-462293f1a752 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 210 time: 0.0476375
Jun 01 18:55:26.192103 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b5dd675a-6fb4-44f2-9338-3ab9dfe6736f req-6039caf3-ba0d-4028-92b1-cf93b4805e56 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 210 time: 0.0436847
Jun 01 18:55:26.896057 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c0c67ad4-f1f2-43ab-b390-c85b25535e5b req-2c659ccf-55a1-46d6-95de-31c203c77e9b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 210 time: 0.0473192
Jun 01 18:55:27.341352 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1b934845-838e-47be-b5c4-fd52f311faea req-cc86229e-891d-4855-bb7a-5be19dd16449 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 210 time: 0.0425436
Jun 01 18:55:27.995957 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-431548e3-37b9-43fb-8c5e-037bd67c4c18 req-093e7a94-8247-47fc-aaf3-b2faf00b0756 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 210 time: 0.0458519
Jun 01 18:55:28.220631 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-2b11f293-b332-4c89-95c0-f58df3855112 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:28.222354 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-2b11f293-b332-4c89-95c0-f58df3855112 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 814 time: 0.1528842
Jun 01 18:55:28.237818 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Request body: {'port': {'device_id': '9172fafe-7696-4fc3-823c-487d740931dd', 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb', 'admin_state_up': True, 'tenant_id': '6606e2f3c3034216a3ea2e1102480063'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:28.376377 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:28.380234 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Usage tracker for resource:port and tenant:6606e2f3c3034216a3ea2e1102480063 is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:28.383128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:28.389542 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:28.400065 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Made reservation on behalf of 6606e2f3c3034216a3ea2e1102480063 for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:28.403887 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:28.620552 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0d6a31c2-d3d0-4f2d-ac23-90c41385a116 req-89d8716d-2447-4186-9676-3c23f8944eb1 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 210 time: 0.1568975
Jun 01 18:55:28.715040 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Allocated IP 172.20.0.13 (0cddf53f-fbeb-4e8a-86ec-9167067ec0cb/a05ac98a-6bf9-4f53-908b-71fcdd651ada/5558d8fb-a66c-435c-93bf-a6359b033722) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:55:28.928726 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:28.953410 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-83ebcc6e-ce6c-4587-99d5-d4ebdc6180ad tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:28.955515 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-83ebcc6e-ce6c-4587-99d5-d4ebdc6180ad tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 808 time: 0.1527660
Jun 01 18:55:28.962409 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:28.968099 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-18f23c88-68ff-44e9-a273-e99b811a94f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:28.973626 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Request body: {'port': {'device_id': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'network_id': '65e659a7-3525-4957-828a-0336c8c79517', 'admin_state_up': True, 'tenant_id': '34d11de3d1ac487f94f3c3470921262e'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:29.040227 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:55:29.044270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:29.047243 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:55:29.092550 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Pushing event updated for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:29.110500 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.110884 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.111265 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.111637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.112003 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.112368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.112761 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:29.113217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.113217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.113510 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.113869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.114293 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.114650 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:29.116646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Usage tracker for resource:port and tenant:34d11de3d1ac487f94f3c3470921262e is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:29.118461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:29.119569 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:29.128722 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:29.134136 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:29.134747 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.155540 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9220357
Jun 01 18:55:29.167822 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Request body: {'port': {'device_id': '9172fafe-7696-4fc3-823c-487d740931dd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:29.175955 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f170943f-6946-4a46-81ef-98f357b28a71 req-921d78eb-c02b-4087-b1d4-b5abc8392785 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 210 time: 0.0483084
Jun 01 18:55:29.176990 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Made reservation on behalf of 34d11de3d1ac487f94f3c3470921262e for: {'port': 1} {{(pid=98259) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:29.180301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.284352 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.437578 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Allocated IP 172.20.0.13 (65e659a7-3525-4957-828a-0336c8c79517/b7838170-f75b-4303-992d-737ef73a33bc/89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:55:29.625703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5558d8fb-a66c-435c-93bf-a6359b033722 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:29.632798 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.635418 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.647100 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Transition to ACTIVE for port object 5558d8fb-a66c-435c-93bf-a6359b033722 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:55:29.652369 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.657732 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-63d638f9-98ff-44cd-a549-e60b607680b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:29.664847 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.670667 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-2258a36e-faab-4431-88d8-5acd6a6f37d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:29.739437 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Network 65e659a7-3525-4957-828a-0336c8c79517 is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:55:29.742597 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:29.746731 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:55:29.783856 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Pushing event updated for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:29.788138 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:29.815972 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:29.816621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.831195 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Pushing event updated for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:29.836896 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-5623ebe7-097c-4720-8580-09ec077d2775 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8676677
Jun 01 18:55:29.852549 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Request body: {'port': {'device_id': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:29.864590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:29.963251 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:29.965961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-e6c8a5ae-86f8-485e-8b2b-342dd3c6e362 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:29.966613 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-e6c8a5ae-86f8-485e-8b2b-342dd3c6e362 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Synchronizing usage tracker for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:29.970872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Attempting to bind port 5558d8fb-a66c-435c-93bf-a6359b033722 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:55:29.971200 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Attempting to bind port 5558d8fb-a66c-435c-93bf-a6359b033722 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:55:29.971522 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Attempting to bind port 5558d8fb-a66c-435c-93bf-a6359b033722 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:29.980563 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Port 5558d8fb-a66c-435c-93bf-a6359b033722 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:55:29.980895 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Attempting to bind port 5558d8fb-a66c-435c-93bf-a6359b033722 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:29.989011 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 55, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:55:29.989356 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Checking segment: {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:29.989768 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Bound using segment: {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:55:29.990263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Bound port: 5558d8fb-a66c-435c-93bf-a6359b033722, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:55:29.990579 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.006257 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-e6c8a5ae-86f8-485e-8b2b-342dd3c6e362 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Unset dirty status for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:30.007407 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-e6c8a5ae-86f8-485e-8b2b-342dd3c6e362 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 944 time: 0.2470331
Jun 01 18:55:30.102513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-2b7b87a6-adfd-49b5-8721-59019fce6d44 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Synchronizing usage tracker for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:30.121208 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:55:30.125153 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5558d8fb-a66c-435c-93bf-a6359b033722,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:55:30.129047 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.133796 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bec11dc4-e96c-45fd-ad8c-52c289754875 tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:30.168719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-2b7b87a6-adfd-49b5-8721-59019fce6d44 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Unset dirty status for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:30.169848 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-efe5bf40-d0d8-4551-ae6e-cae7db245774 req-2b7b87a6-adfd-49b5-8721-59019fce6d44 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1326699
Jun 01 18:55:30.197217 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:30.197934 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.199284 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] 10.222.0.25 "PUT /v2.0/ports/5558d8fb-a66c-435c-93bf-a6359b033722 HTTP/1.1" status: 200  len: 1094 time: 1.0356386
Jun 01 18:55:30.199790 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:30.202173 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1267a45-a335-4fc4-91db-8b643ded4a96" -d '{"events": [{"name": "network-changed", "server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:30.224162 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Pushing event updated for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:30.227268 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:30.282147 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c503fed-fa39-489b-8969-425c1d3701fd x-openstack-request-id: req-9c503fed-fa39-489b-8969-425c1d3701fd {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:30.282611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:30.282998 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-9c503fed-fa39-489b-8969-425c1d3701fd {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:30.283520 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722', 'status': 'completed', 'code': 200}
Jun 01 18:55:30.314128 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 {{(pid=98259) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:30.323145 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.325562 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-4ccfa9d1-e109-4c7d-8d2f-d2d367fe0ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:30.327039 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-4ccfa9d1-e109-4c7d-8d2f-d2d367fe0ab2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 1097 time: 0.0814326
Jun 01 18:55:30.382181 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.provisioning_blocks [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Transition to ACTIVE for port object 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 will not be triggered until provisioned by entity L2. {{(pid=98259) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:55:30.385673 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.390856 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c847c4d4-a5d7-49bd-8346-b7fab683fdf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:30.404412 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-8a215dbe-b682-4601-97ce-dbbc56919a4c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5558d8fb-a66c-435c-93bf-a6359b033722 HTTP/1.1" status: 200  len: 217 time: 0.0660412
Jun 01 18:55:30.471075 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a9e3a-666f-476a-817f-133aab076c2b req-a1108dcf-5ada-422a-9518-f0f5f3a40fc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:30.472449 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-a1108dcf-5ada-422a-9518-f0f5f3a40fc0 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 200  len: 854 time: 0.0582874
Jun 01 18:55:30.522540 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-d5052816-3123-4fcd-80e6-b3450cfb47c4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0394506
Jun 01 18:55:30.527987 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Pushing event updated for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:30.533340 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:30.604999 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bad577-7797-4fc0-b0c0-b06b811e9ca3 req-f8873c4f-fb0c-4d3c-8541-b859a1d9e424 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:30.605729 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-72bad577-7797-4fc0-b0c0-b06b811e9ca3 req-f8873c4f-fb0c-4d3c-8541-b859a1d9e424 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Synchronizing usage tracker for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:30.642183 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-72bad577-7797-4fc0-b0c0-b06b811e9ca3 req-f8873c4f-fb0c-4d3c-8541-b859a1d9e424 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Unset dirty status for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:30.643350 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72bad577-7797-4fc0-b0c0-b06b811e9ca3 req-f8873c4f-fb0c-4d3c-8541-b859a1d9e424 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 932 time: 0.3226843
Jun 01 18:55:30.680173 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Attempting to bind port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:55:30.680536 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Attempting to bind port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:55:30.680899 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Attempting to bind port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 on network 65e659a7-3525-4957-828a-0336c8c79517 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:30.696238 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 on network 65e659a7-3525-4957-828a-0336c8c79517 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:55:30.696599 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Attempting to bind port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 on network 65e659a7-3525-4957-828a-0336c8c79517 {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:30.705357 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 55, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:55:30.705708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Checking segment: {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98259) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:30.706080 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Bound using segment: {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'} {{(pid=98259) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:55:30.706503 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.managers [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Bound port: 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'}}] {{(pid=98259) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:55:30.706851 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.718993 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-72bad577-7797-4fc0-b0c0-b06b811e9ca3 req-0300a169-8b07-4b0d-bfe1-600beb344c02 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0657380
Jun 01 18:55:30.762223 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-ab6a3f67-35d6-478e-b29c-972dcf4a3a6a service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2283919
Jun 01 18:55:30.802743 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, cleared binding levels {{(pid=98259) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:55:30.805701 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98259) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:55:30.810646 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.815653 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4cb827f4-5b1b-4b16-8949-9826f796b5d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:30.872272 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:30.872971 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:30.874426 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] 10.222.0.25 "PUT /v2.0/ports/89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 HTTP/1.1" status: 200  len: 1094 time: 1.0260684
Jun 01 18:55:30.874933 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:30.877868 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3eb8e9f6-c278-416b-a277-16a9758c5106" -d '{"events": [{"name": "network-changed", "server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:30.900974 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Pushing event updated for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=3']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:30.905310 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:30.910533 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-152a9e3a-666f-476a-817f-133aab076c2b req-614c46e6-470b-42ae-8e46-96253019c43b service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1377835
Jun 01 18:55:30.922779 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f430bf57-693b-44ef-9275-ad2b74edca09 x-openstack-request-id: req-f430bf57-693b-44ef-9275-ad2b74edca09 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:30.923916 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:30.924215 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-f430bf57-693b-44ef-9275-ad2b74edca09 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:30.924685 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9', 'status': 'completed', 'code': 200}
Jun 01 18:55:30.999138 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-9c9f1ec7-6842-49f5-80b3-b144dec45e6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.001229 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-9c9f1ec7-6842-49f5-80b3-b144dec45e6c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 1097 time: 0.0737913
Jun 01 18:55:31.033009 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-ddc97599-2486-40f9-8481-4c8bdf54f2d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.034467 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-ddc97599-2486-40f9-8481-4c8bdf54f2d7 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 1097 time: 0.0750103
Jun 01 18:55:31.073381 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-e5bee188-6cc6-4414-ad54-d201777c1a2e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 HTTP/1.1" status: 200  len: 217 time: 0.0641129
Jun 01 18:55:31.136133 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-68822766-ea35-48fa-a82b-f95551e12071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.137601 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-68822766-ea35-48fa-a82b-f95551e12071 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b7838170-f75b-4303-992d-737ef73a33bc HTTP/1.1" status: 200  len: 848 time: 0.0572755
Jun 01 18:55:31.186623 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-07876aa7-dbc6-4f0f-b918-2b10cdcf0134 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=65e659a7-3525-4957-828a-0336c8c79517&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0419948
Jun 01 18:55:31.266741 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-6e6cee04-5828-4d5b-ad88-d23e72d75e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.268112 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-6e6cee04-5828-4d5b-ad88-d23e72d75e6a service neutron] 10.222.0.25 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 914 time: 0.2248275
Jun 01 18:55:31.324613 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-8d882da1-14bc-4af9-b0dd-3cfcdce07c8d service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1296306
Jun 01 18:55:31.368523 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-00f0ec82-ffc5-49c4-8a41-18fcbd0439e8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5558d8fb-a66c-435c-93bf-a6359b033722 HTTP/1.1" status: 200  len: 217 time: 0.0925491
Jun 01 18:55:31.451710 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-bc08dfad-040f-4dd1-a3f0-7a4128443730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.453173 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-bc08dfad-040f-4dd1-a3f0-7a4128443730 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 200  len: 854 time: 0.0736997
Jun 01 18:55:31.454611 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-6f5b775c-1a5c-40f4-aef2-46ad0e21fb6c req-a7980022-3bdc-4398-84bf-543c0a108171 service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1224170
Jun 01 18:55:31.469165 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa443a-9d69-4793-bca0-6da1a93e86b1 req-391e0458-b461-462e-b772-bc09df381823 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.470682 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f3aa443a-9d69-4793-bca0-6da1a93e86b1 req-391e0458-b461-462e-b772-bc09df381823 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 944 time: 0.1425347
Jun 01 18:55:31.535205 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-78de782d-0957-4db8-9ece-f00693122f33 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0635600
Jun 01 18:55:31.580784 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f3aa443a-9d69-4793-bca0-6da1a93e86b1 req-be942d58-097f-4854-bbc3-9745cac8760a tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0775723
Jun 01 18:55:31.581010 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-000f51c8-fff0-4637-a09e-2eb915a2ee77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.582390 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-000f51c8-fff0-4637-a09e-2eb915a2ee77 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 1097 time: 0.0751741
Jun 01 18:55:31.692062 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-683d35b0-fdbc-46c9-b8c9-e1e7056a56ec service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1450050
Jun 01 18:55:31.713397 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-2e967afc-d6ca-4865-b600-45951dafc7ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.714811 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-2e967afc-d6ca-4865-b600-45951dafc7ca service neutron] 10.222.0.25 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 908 time: 0.1251695
Jun 01 18:55:31.789308 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-1fe6010b-3843-473b-93f5-16e66dd4e260 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 HTTP/1.1" status: 200  len: 217 time: 0.0672741
Jun 01 18:55:31.828700 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-b1267a45-a335-4fc4-91db-8b643ded4a96 req-aba7dcdc-b8e6-4784-9f32-3429deb20df2 service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1291935
Jun 01 18:55:31.898055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-c74d5759-c09e-42c6-a931-79f0b5ef2440 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:31.899753 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-c74d5759-c09e-42c6-a931-79f0b5ef2440 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b7838170-f75b-4303-992d-737ef73a33bc HTTP/1.1" status: 200  len: 848 time: 0.1031256
Jun 01 18:55:31.955267 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-54d74adb-72f5-46fa-ac49-35c22347cd4d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=65e659a7-3525-4957-828a-0336c8c79517&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0471044
Jun 01 18:55:31.999980 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437b0ee7-68fc-4dc0-9ad3-e99bd5c961a7 req-bc258ad9-fa69-4404-a337-5b8a7e016bf6 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:32.002059 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-437b0ee7-68fc-4dc0-9ad3-e99bd5c961a7 req-bc258ad9-fa69-4404-a337-5b8a7e016bf6 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 944 time: 0.1721909
Jun 01 18:55:32.115889 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-437b0ee7-68fc-4dc0-9ad3-e99bd5c961a7 req-c5bfa708-7ec7-44fa-a82b-07eddb302c11 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Synchronizing usage tracker for tenant:34d11de3d1ac487f94f3c3470921262e on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:32.148332 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-e9b3e7b1-b71a-421c-b625-511389efa5ed service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1846340
Jun 01 18:55:32.153697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-437b0ee7-68fc-4dc0-9ad3-e99bd5c961a7 req-c5bfa708-7ec7-44fa-a82b-07eddb302c11 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Unset dirty status for tenant:34d11de3d1ac487f94f3c3470921262e on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:32.154756 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-437b0ee7-68fc-4dc0-9ad3-e99bd5c961a7 req-c5bfa708-7ec7-44fa-a82b-07eddb302c11 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1415520
Jun 01 18:55:32.206686 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cee497b-dca2-4c45-9c16-e8a3ccfd90f0 req-bb110270-b96a-45e2-8e26-8da0ac996634 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:32.208377 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0cee497b-dca2-4c45-9c16-e8a3ccfd90f0 req-bb110270-b96a-45e2-8e26-8da0ac996634 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0847695
Jun 01 18:55:32.255471 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0cee497b-dca2-4c45-9c16-e8a3ccfd90f0 req-bc9edcc4-264d-419b-b1ff-cf3f67b8cda7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412374
Jun 01 18:55:32.372178 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3eb8e9f6-c278-416b-a277-16a9758c5106 req-7f96ffdb-46c0-41eb-af86-6a621ceec4ef service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2163754
Jun 01 18:55:32.760558 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0a978-4308-445e-9710-d8f796516c77 req-1deb8cc3-d99c-4b1b-bd62-fc4953e4cd63 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:32.762013 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dad0a978-4308-445e-9710-d8f796516c77 req-1deb8cc3-d99c-4b1b-bd62-fc4953e4cd63 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 944 time: 0.0787804
Jun 01 18:55:32.762306 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5558d8fb-a66c-435c-93bf-a6359b033722 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:55:32.813973 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dad0a978-4308-445e-9710-d8f796516c77 req-de5f8048-05da-4fb8-8243-ee12378876b1 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454075
Jun 01 18:55:32.898457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5558d8fb-a66c-435c-93bf-a6359b033722,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:32.911928 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '5558d8fb-a66c-435c-93bf-a6359b033722', 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb', 'port_id': '5558d8fb-a66c-435c-93bf-a6359b033722', 'mac_address': 'fa:16:3e:ce:2a:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 75, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a05ac98a-6bf9-4f53-908b-71fcdd651ada', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:55:32.972086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:32.988831 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5558d8fb-a66c-435c-93bf-a6359b033722 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:33.003407 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5558d8fb-a66c-435c-93bf-a6359b033722,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:33.007502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:33.009280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-12193100-b6ea-449f-9b87-943b2e683c28 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:33.072559 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:33.079465 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.079810 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.080143 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.080528 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.080857 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.081183 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.081502 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.081819 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.082134 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.082448 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.082761 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.083072 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:33.086667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:33.259816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['5558d8fb-a66c-435c-93bf-a6359b033722'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:55:33.350134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1570f1cb-9332-4345-9be6-34f353322259 req-77dfee00-042d-4a2a-9ed5-942b924d1349 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:33.351790 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1570f1cb-9332-4345-9be6-34f353322259 req-77dfee00-042d-4a2a-9ed5-942b924d1349 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 944 time: 0.0885017
Jun 01 18:55:33.396368 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-1570f1cb-9332-4345-9be6-34f353322259 req-e8253727-830f-421b-afaf-a6b99025805b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388441
Jun 01 18:55:33.448803 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf8bc0e-81e9-41f1-9a3d-41d01b0c7274 req-d50e9b17-030d-4c98-b2c1-7cfa9335fc14 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:33.450373 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2cf8bc0e-81e9-41f1-9a3d-41d01b0c7274 req-d50e9b17-030d-4c98-b2c1-7cfa9335fc14 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0828717
Jun 01 18:55:33.501764 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2cf8bc0e-81e9-41f1-9a3d-41d01b0c7274 req-a30747b7-5bda-4172-ba89-1a31c73243fa tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441692
Jun 01 18:55:33.841607 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-dd4abae2-8ab5-42ea-9b96-06e568eeb909 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:33.842806 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-dd4abae2-8ab5-42ea-9b96-06e568eeb909 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 946 time: 0.0827196
Jun 01 18:55:33.977732 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port ae69b620-8054-4500-b3ca-90716cc72e67 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:55:33.978073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:34.005591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b8711f2-1ab5-4d16-bbf7-f93b08a4cd9e req-74e380e5-4336-4250-9d6d-0dabd00dd12d tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:34.007058 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b8711f2-1ab5-4d16-bbf7-f93b08a4cd9e req-74e380e5-4336-4250-9d6d-0dabd00dd12d tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 945 time: 0.0785534
Jun 01 18:55:34.054746 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b8711f2-1ab5-4d16-bbf7-f93b08a4cd9e req-c256d2cc-491a-44fd-ac89-0af69bc83fd6 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418582
Jun 01 18:55:34.107919 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] For port ae69b620-8054-4500-b3ca-90716cc72e67, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ae69b620-8054-4500-b3ca-90716cc72e67,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:34.108276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:34.392328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:34.392640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:34.392944 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 22d10692-4f6e-4d14-afbc-e04c94671322 disassociated. External IP: 172.27.0.107, port: ae69b620-8054-4500-b3ca-90716cc72e67.
Jun 01 18:55:34.393276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for ae69b620-8054-4500-b3ca-90716cc72e67 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:55:34.535103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:34.544607 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:34.595825 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=ae69b620-8054-4500-b3ca-90716cc72e67,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:34.598898 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:34.653351 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-d42744fc-7216-4550-99cf-392f3c897135 req-bd4f7800-59dc-41e3-bcbd-1b7643aebf4d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 210 time: 0.0436921
Jun 01 18:55:34.771409 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d94c39-1df6-4e69-9202-ca9afa7208ee req-6195d98d-e9d7-4718-8a63-79e78f5633dd tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:34.772916 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e8d94c39-1df6-4e69-9202-ca9afa7208ee req-6195d98d-e9d7-4718-8a63-79e78f5633dd tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 944 time: 0.2733150
Jun 01 18:55:34.780661 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:55:34.784808 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5558d8fb-a66c-435c-93bf-a6359b033722 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:55:34.836044 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:55:34.841108 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e8d94c39-1df6-4e69-9202-ca9afa7208ee req-834aa869-64a2-416d-b5b1-011aefe5cec0 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576057
Jun 01 18:55:34.956188 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 5558d8fb-a66c-435c-93bf-a6359b033722 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:55:34.965468 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 5558d8fb-a66c-435c-93bf-a6359b033722 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:55:34.965861 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.034277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:35.055976 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9', 'network_id': '65e659a7-3525-4957-828a-0336c8c79517', 'port_id': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9', 'mac_address': 'fa:16:3e:26:e6:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 93, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b7838170-f75b-4303-992d-737ef73a33bc', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:55:35.132341 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:55:35.147550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:55:35.184959 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:55:35.185480 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd6b26d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:55:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:35.209267 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] No DVR routers for this DVR port ae69b620-8054-4500-b3ca-90716cc72e67 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:55:35.211994 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.215961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'name': 'network-vif-deleted', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:35.218545 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1abc0f70-743f-4d98-8090-a81b45e06673" -d '{"events": [{"server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "name": "network-vif-deleted", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:35.231829 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-78e8ace0-78ff-42a4-8074-8e7aea8e1bde req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "DELETE /v2.0/ports/ae69b620-8054-4500-b3ca-90716cc72e67 HTTP/1.1" status: 204  len: 173 time: 1.3825498
Jun 01 18:55:35.241070 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.271750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd125860-f302-4af2-a999-3fc024c70c8b x-openstack-request-id: req-fd125860-f302-4af2-a999-3fc024c70c8b {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:35.272587 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a097c15e-b2fe-4103-b524-cf5412aedc80", "name": "network-vif-deleted", "tag": "ae69b620-8054-4500-b3ca-90716cc72e67", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:35.272982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-fd125860-f302-4af2-a999-3fc024c70c8b {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:35.274177 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a097c15e-b2fe-4103-b524-cf5412aedc80', 'name': 'network-vif-deleted', 'tag': 'ae69b620-8054-4500-b3ca-90716cc72e67', 'status': 'completed', 'code': 200}
Jun 01 18:55:35.282015 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55964c96-c97e-4515-8beb-2bce4d6ff144 req-e8e3eeef-4411-4e6e-84a6-581fbf608a84 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:35.283845 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-55964c96-c97e-4515-8beb-2bce4d6ff144 req-e8e3eeef-4411-4e6e-84a6-581fbf608a84 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 945 time: 0.1071534
Jun 01 18:55:35.316346 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.329678 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:35.331835 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-55964c96-c97e-4515-8beb-2bce4d6ff144 req-14fe03b5-060d-4639-a1d5-4c242761249b tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417390
Jun 01 18:55:35.446065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:35.448237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7aca0bb8-d634-4793-bf1c-8e9d450dfc37" -d '{"events": [{"server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "name": "network-vif-plugged", "status": "completed", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:35.451878 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:35.459982 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.464365 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-cf00e495-81fd-4ade-9074-fa1d6834c292 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:35.501539 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5558d8fb-a66c-435c-93bf-a6359b033722,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:35.503229 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-433e390f-b86d-4dc5-8c2e-8981f8e3d175 x-openstack-request-id: req-433e390f-b86d-4dc5-8c2e-8981f8e3d175 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:35.503519 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "name": "network-vif-plugged", "status": "completed", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:35.503778 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-433e390f-b86d-4dc5-8c2e-8981f8e3d175 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:35.504226 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722', 'code': 200}
Jun 01 18:55:35.521801 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:35.525010 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:55:35.668132 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:35.677857 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:35.678311 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ae198ed8-626a-4b00-ac93-7b15e9e072ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.102s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:35.712114 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:55:35.756152 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ab13af-bc11-4afe-bf47-cf170e56198f req-c09a62ac-b295-43d6-923f-6b5c38a9d727 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:35.757791 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97ab13af-bc11-4afe-bf47-cf170e56198f req-c09a62ac-b295-43d6-923f-6b5c38a9d727 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 1099 time: 0.0860977
Jun 01 18:55:35.802691 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97ab13af-bc11-4afe-bf47-cf170e56198f req-89c68e14-7d93-410b-886d-f828a4b67cf0 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0372765
Jun 01 18:55:35.829144 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-bcd4baa0-2c6c-4491-a043-a105dca2a663 req-ef9046d9-f02e-43d9-b0f9-15397a25da20 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=a097c15e-b2fe-4103-b524-cf5412aedc80 HTTP/1.1" status: 200  len: 210 time: 0.0465369
Jun 01 18:55:35.890046 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:35.895950 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:36.033085 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8d49b95-68cc-4c99-abbf-ecb1c3e0f6a1 req-5487dd9a-910c-44ab-9f0a-39c209f4423d tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:36.034554 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8d49b95-68cc-4c99-abbf-ecb1c3e0f6a1 req-5487dd9a-910c-44ab-9f0a-39c209f4423d tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 945 time: 0.0816667
Jun 01 18:55:36.078237 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd6b26d0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:36.082778 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c8d49b95-68cc-4c99-abbf-ecb1c3e0f6a1 req-363f4129-f76d-4e02-936b-44552211b531 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425189
Jun 01 18:55:36.084725 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:55:36.096170 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:55:36.096679 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd6b26d0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:55:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:36.277243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:55:36.530850 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a7d19e-7743-487f-a9dc-e57afa7c9e88 req-dc0f2fcb-db7c-4138-a199-7069a2c6dbbc tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:36.532803 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04a7d19e-7743-487f-a9dc-e57afa7c9e88 req-dc0f2fcb-db7c-4138-a199-7069a2c6dbbc tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 946 time: 0.0927267
Jun 01 18:55:36.582381 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-04a7d19e-7743-487f-a9dc-e57afa7c9e88 req-eba6da1b-41aa-485b-899a-30a60d32fda1 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424516
Jun 01 18:55:36.616362 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd6b26d0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:36.620576 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eb2a292-3249-45c4-afe6-40798b35fb22 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:55:36.778403 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:55:36.863050 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:55:36.863785 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae3bf29-de72-4a7c-b6ff-e2d201eb3245 None None] New status for floating IP 22d10692-4f6e-4d14-afbc-e04c94671322: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:55:36.870994 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:55:36.870994 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:37.002999 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:37.059753 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:37.065286 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:37.066442 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ae69b620-8054-4500-b3ca-90716cc72e67 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:55:37.177943 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:37.226892 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: ae69b620-8054-4500-b3ca-90716cc72e67 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:55:37.227275 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ae69b620-8054-4500-b3ca-90716cc72e67 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:55:37.229858 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:55:37.257735 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:37.260839 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:37.313070 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38057711-d66c-4cde-95f5-a22830d65c17 req-511b261e-74a4-4aba-bdbb-0e7e1ecd0949 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:37.314346 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-f121a59c-f52e-4641-a3bb-d6abfe79969d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2096723707&fields=id&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 267 time: 0.0413404
Jun 01 18:55:37.314791 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-38057711-d66c-4cde-95f5-a22830d65c17 req-511b261e-74a4-4aba-bdbb-0e7e1ecd0949 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.0944395
Jun 01 18:55:37.361158 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-38057711-d66c-4cde-95f5-a22830d65c17 req-1d029d77-9d26-4f1d-b758-f8f7bb2d59b4 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409095
Jun 01 18:55:37.471718 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-e2756a01-c54f-458f-88fc-a8e0264f3d52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:37.476534 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-e2756a01-c54f-458f-88fc-a8e0264f3d52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.1521790
Jun 01 18:55:37.488091 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-faedd021-5991-4f6f-a4a1-93a93ff40e22 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/quotas/52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 375 time: 0.0091922
Jun 01 18:55:37.505032 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:37.507330 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbd09558-c28f-49f9-87fc-4e8e055eb405" -d '{"events": [{"server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "name": "network-vif-plugged", "status": "completed", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:37.552557 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3c16a3f-c975-4ef1-9313-75019ad7c6e7 x-openstack-request-id: req-a3c16a3f-c975-4ef1-9313-75019ad7c6e7 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:37.553051 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "name": "network-vif-plugged", "status": "completed", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:37.553304 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-a3c16a3f-c975-4ef1-9313-75019ad7c6e7 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:37.553699 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9', 'code': 200}
Jun 01 18:55:37.576820 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-bd06622a-418c-477c-93cf-f552f4d84b02 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:37.597637 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-bd06622a-418c-477c-93cf-f552f4d84b02 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:37.598961 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-bd06622a-418c-477c-93cf-f552f4d84b02 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1058505
Jun 01 18:55:37.795132 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ba03e2a7-cedc-4fcc-98cb-e97b747c7342 service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1832325
Jun 01 18:55:37.802767 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3343522e-8da1-4c5d-a88c-1bcc1954242d req-def4e1bc-9992-4f36-ab81-9dc96ae747fb tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:37.804516 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3343522e-8da1-4c5d-a88c-1bcc1954242d req-def4e1bc-9992-4f36-ab81-9dc96ae747fb tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 946 time: 0.0941138
Jun 01 18:55:37.853973 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3343522e-8da1-4c5d-a88c-1bcc1954242d req-c14bb379-61a1-431c-815c-1759fac56090 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437596
Jun 01 18:55:37.913300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440a666e-aadf-4fbb-ac6c-f94a9ac2ae07 req-fe7bee73-a971-40ea-9220-f9e828e62ecc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:37.913300 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-440a666e-aadf-4fbb-ac6c-f94a9ac2ae07 req-fe7bee73-a971-40ea-9220-f9e828e62ecc service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 1099 time: 0.1867979
Jun 01 18:55:37.981520 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-440a666e-aadf-4fbb-ac6c-f94a9ac2ae07 req-064f3ecc-afc6-427e-b984-543367b905d5 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0619867
Jun 01 18:55:37.983379 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-0482618e-cd9a-43bf-81a9-dcff9ecfaa17 service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1787598
Jun 01 18:55:38.405850 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a915d959-b39d-4714-8b69-a16af75fde0c req-cda9795c-c98d-41e1-9161-c6f265f7f6d3 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 210 time: 0.0583637
Jun 01 18:55:38.582634 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84d48d21-1469-437d-bc7d-3e6945f15a33 req-6bc94c7c-05ee-448d-9d6d-40364c65b7fc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:38.584374 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84d48d21-1469-437d-bc7d-3e6945f15a33 req-6bc94c7c-05ee-448d-9d6d-40364c65b7fc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.0899742
Jun 01 18:55:38.633915 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-84d48d21-1469-437d-bc7d-3e6945f15a33 req-c578142c-c376-4ca4-b9fe-3749e73eaa60 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433009
Jun 01 18:55:39.350349 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-99667f74-5315-4ac5-80bb-03a908bf04e5 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0711830
Jun 01 18:55:39.530690 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-e4864739-79d8-42ad-9334-44f8b332fe4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:39.532957 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-e4864739-79d8-42ad-9334-44f8b332fe4f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 1099 time: 0.1027503
Jun 01 18:55:39.579654 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-c4773198-3db8-46c8-af4f-d675c3a1c4b3 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:39.581403 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-c4773198-3db8-46c8-af4f-d675c3a1c4b3 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.1736951
Jun 01 18:55:39.645026 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-b3ac7036-d5b0-45d1-a144-94f06d879321 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 380 time: 0.0448515
Jun 01 18:55:39.658012 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'port': {'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'admin_state_up': True, 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'security_groups': ['79b7f04f-c3ff-42d0-82b2-2e6dd86603f0']}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:39.815800 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f2b1aacc-fcdc-48c4-86b8-0532ff008a60 req-eba00290-834c-44b6-b904-9c886abf61d8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 210 time: 0.2209673
Jun 01 18:55:39.852907 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-1ff67ad6-4d86-422b-8870-b2aafca05253 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:39.854293 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-1ff67ad6-4d86-422b-8870-b2aafca05253 service neutron] 10.222.0.25 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 914 time: 0.3017900
Jun 01 18:55:39.864991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:39.882745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:39.898273 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Made reservation on behalf of 52dbd90f0982402bb02a793614e0020d for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:39.901965 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:39.924611 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-3e855142-86af-404b-ac07-69009cab59e8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5558d8fb-a66c-435c-93bf-a6359b033722 HTTP/1.1" status: 200  len: 217 time: 0.0625064
Jun 01 18:55:39.928868 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab2b438-5fc4-4ede-86bd-5e2647c3c6bb req-a6aa4ae5-6c09-4ae5-ab17-b2681da1328c tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:39.930302 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8ab2b438-5fc4-4ede-86bd-5e2647c3c6bb req-a6aa4ae5-6c09-4ae5-ab17-b2681da1328c tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.1398518
Jun 01 18:55:39.992267 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-6a61e1fa-bd2b-4c56-80a8-d3c0355b5e91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:39.993733 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-6a61e1fa-bd2b-4c56-80a8-d3c0355b5e91 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 200  len: 854 time: 0.0627809
Jun 01 18:55:40.036956 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-8ab2b438-5fc4-4ede-86bd-5e2647c3c6bb req-78873eb8-d397-46e7-ae4e-53898a7a54a5 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0706410
Jun 01 18:55:40.046911 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-982b2b13-7391-4bb1-ab4b-826bfb0714b9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0413721
Jun 01 18:55:40.190108 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-315d579d-43e9-4342-b0bd-c7002ab1d3c7 service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1362808
Jun 01 18:55:40.238913 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.20.0.10 (ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27/e07cf14f-41ea-4248-9d27-d63b4df58f40/ef46ff60-b962-43c5-bb89-c3d73b4dd406) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:55:40.329803 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-7c7521ed-41f0-41a0-b9a2-a2bbbcafd976 req-ccdf9777-3f9e-4780-963e-267ddfefd011 service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1335855
Jun 01 18:55:40.459143 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.474445 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Transition to ACTIVE for port object ef46ff60-b962-43c5-bb89-c3d73b4dd406 will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:55:40.502668 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.509476 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4fc6a47a-8795-4d00-a92d-7739d5af3b0f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:40.575414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:55:40.578465 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:40.580912 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:55:40.623592 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:40.628661 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:40.655352 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:40.656046 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.692335 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0380838
Jun 01 18:55:40.705270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Request body: {'port': {'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:40.829952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.837867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.891918 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2f3694b8-e987-442b-8a3e-78976de4cdf1 None None] Provisioning for port ef46ff60-b962-43c5-bb89-c3d73b4dd406 completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:55:40.899291 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-2f3694b8-e987-442b-8a3e-78976de4cdf1 None None] Provisioning complete for port ef46ff60-b962-43c5-bb89-c3d73b4dd406 triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:55:40.900200 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-2f3694b8-e987-442b-8a3e-78976de4cdf1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:40.972096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-2f3694b8-e987-442b-8a3e-78976de4cdf1 None None] Port ef46ff60-b962-43c5-bb89-c3d73b4dd406 cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:55:41.166990 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87cfb04e-9720-42a6-8380-cd34aa4a6141 req-88f7486d-d83d-49ba-86e4-0b4450c38151 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:41.167697 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-87cfb04e-9720-42a6-8380-cd34aa4a6141 req-88f7486d-d83d-49ba-86e4-0b4450c38151 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:41.174637 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9034d21-e063-4ed4-938e-d85cbdc00882 req-2b617b23-2ae8-48e8-a56e-3bfd7a3c459d tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:41.176365 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e9034d21-e063-4ed4-938e-d85cbdc00882 req-2b617b23-2ae8-48e8-a56e-3bfd7a3c459d tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.0869765
Jun 01 18:55:41.203260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-87cfb04e-9720-42a6-8380-cd34aa4a6141 req-88f7486d-d83d-49ba-86e4-0b4450c38151 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:41.204985 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-87cfb04e-9720-42a6-8380-cd34aa4a6141 req-88f7486d-d83d-49ba-86e4-0b4450c38151 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 932 time: 0.2400951
Jun 01 18:55:41.227479 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-e9034d21-e063-4ed4-938e-d85cbdc00882 req-74484149-37b2-405c-8c81-bba9c7f2bf49 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455937
Jun 01 18:55:41.307288 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-87cfb04e-9720-42a6-8380-cd34aa4a6141 req-83cbec63-ced7-4f3b-8d7d-5ad82ce8e0c1 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0962048
Jun 01 18:55:41.314973 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ef46ff60-b962-43c5-bb89-c3d73b4dd406 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:41.322454 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:41.337658 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Transition to ACTIVE for port object ef46ff60-b962-43c5-bb89-c3d73b4dd406 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:55:41.341488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:41.345451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6f42099f-74f4-487d-b703-892ea09a0dd0 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:41.494719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Pushing event updated for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:41.504205 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:41.578518 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Attempting to bind port ef46ff60-b962-43c5-bb89-c3d73b4dd406 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:55:41.578950 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Attempting to bind port ef46ff60-b962-43c5-bb89-c3d73b4dd406 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:55:41.579282 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Attempting to bind port ef46ff60-b962-43c5-bb89-c3d73b4dd406 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:41.585157 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Port ef46ff60-b962-43c5-bb89-c3d73b4dd406 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:55:41.585705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Attempting to bind port ef46ff60-b962-43c5-bb89-c3d73b4dd406 on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:41.593639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 55, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:55:41.594131 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:41.594513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Bound using segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:55:41.594956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Bound port: ef46ff60-b962-43c5-bb89-c3d73b4dd406, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:55:41.595310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:41.693184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:55:41.696034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:55:41.701088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:41.705670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:41.773000 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:41.773694 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:41.775407 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] 10.222.0.25 "PUT /v2.0/ports/ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 1094 time: 1.0749660
Jun 01 18:55:41.776255 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:41.778694 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfc6cdca-493b-4912-a59c-9dc7b93e8139" -d '{"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:41.792706 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Pushing event updated for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:41.813956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:41.859156 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d324836e-8ac0-40d2-a6dc-bcff01ab1d16 x-openstack-request-id: req-d324836e-8ac0-40d2-a6dc-bcff01ab1d16 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:41.859485 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:41.860298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-d324836e-8ac0-40d2-a6dc-bcff01ab1d16 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:41.860827 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'status': 'completed', 'code': 200}
Jun 01 18:55:41.902487 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-0128d961-4c97-41a7-907b-824700176c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:41.903973 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-0128d961-4c97-41a7-907b-824700176c9e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1097 time: 0.0780292
Jun 01 18:55:41.977042 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-b03759ad-57e3-45c3-a2ac-0a5ffedd4dfe service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 217 time: 0.0645733
Jun 01 18:55:42.045040 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-726d6be3-1140-4dca-b2e0-8b95b56f2092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.046475 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-726d6be3-1140-4dca-b2e0-8b95b56f2092 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0621102
Jun 01 18:55:42.209579 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-1b139876-fa2a-4444-82f0-f5c219c93e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.211057 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-1b139876-fa2a-4444-82f0-f5c219c93e37 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1571825
Jun 01 18:55:42.398891 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-1c57f2de-2ea3-4dd6-a62b-0bb26d6c220e service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1742892
Jun 01 18:55:42.544747 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39fb7121-6c46-4c45-a2bf-d0513801bc27 req-02fd35f2-e55a-495e-ad5d-73640ae885a2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.546222 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-39fb7121-6c46-4c45-a2bf-d0513801bc27 req-02fd35f2-e55a-495e-ad5d-73640ae885a2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.1262217
Jun 01 18:55:42.546675 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bcf391-7ce7-42a0-82f0-7131c0eb9441 req-2e27d2e9-6272-4830-a5bf-ea03ed990d90 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.548971 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90bcf391-7ce7-42a0-82f0-7131c0eb9441 req-2e27d2e9-6272-4830-a5bf-ea03ed990d90 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.2001703
Jun 01 18:55:42.587127 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3b09f9c9-21a8-4627-be6c-b6a8f6a4e63c req-3ee66ea2-2e55-41b6-967a-9d2f77412f7a service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1793783
Jun 01 18:55:42.609027 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-90bcf391-7ce7-42a0-82f0-7131c0eb9441 req-b3f428cd-13b0-4815-aa35-32bf8bbf2520 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482376
Jun 01 18:55:42.611637 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-39fb7121-6c46-4c45-a2bf-d0513801bc27 req-4deb61f4-a567-42c5-8260-9af0dc9060ee tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0552270
Jun 01 18:55:42.636483 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-f977510a-a8f4-4757-8536-a60acf314cbc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.636483 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-f977510a-a8f4-4757-8536-a60acf314cbc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 946 time: 0.1563156
Jun 01 18:55:42.727459 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-620f751a-4523-4c4e-911e-2cb5628d0b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.729215 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-620f751a-4523-4c4e-911e-2cb5628d0b83 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1097 time: 0.0816140
Jun 01 18:55:42.801927 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Deleting port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:55:42.802408 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:42.884107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-1d35c078-a9ac-4a37-aafc-bd8f0cc67eb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:42.885471 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-1d35c078-a9ac-4a37-aafc-bd8f0cc67eb8 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1497831
Jun 01 18:55:42.943205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.db [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] For port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98259) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:42.943561 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:42.958673 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-8f47e76b-bcf4-4629-a57d-52628d8c76ad service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 217 time: 0.0633469
Jun 01 18:55:43.027104 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-4a589ad7-465c-4dbf-858c-6debdaedbd58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:43.028571 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-4a589ad7-465c-4dbf-858c-6debdaedbd58 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0627787
Jun 01 18:55:43.068135 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Calling delete_port for 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 owned by compute:nova {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:55:43.107607 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-02c5ee0c-7e02-484d-968e-ef90b35316d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:43.109146 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-02c5ee0c-7e02-484d-968e-ef90b35316d1 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0715871
Jun 01 18:55:43.183167 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:43.189871 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-bddaeaf1-d421-4020-afcb-40e26ed0783f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:43.198218 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:55:43.235506 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Pushing event deleted for resources: {'Port': ['ID=89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:43.244147 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.244571 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-e7360cc0-2704-4725-abdc-3a198f067ee3 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278405
Jun 01 18:55:43.244702 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.245019 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.245390 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.245751 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.246233 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.246591 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.246947 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.247653 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.247827 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.248282 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.248660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:55:43.282387 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:43.326671 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] No DVR routers for this DVR port 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 on host hv-cinder-79402 {{(pid=98259) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:55:43.329508 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:43.332182 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'name': 'network-vif-deleted', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:43.334452 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae090f9d-2de3-4d08-9a9d-91a7408b4118" -d '{"events": [{"server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "name": "network-vif-deleted", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:43.349165 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0501ca24-a193-4f9c-aa82-27d7f4578d95 req-0ca899d6-dc5d-4e0c-99ac-e9672c9c9636 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "DELETE /v2.0/ports/89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 HTTP/1.1" status: 204  len: 173 time: 0.7066252
Jun 01 18:55:43.379260 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38e5e496-61ad-43f0-8ca1-04286030fee8 x-openstack-request-id: req-38e5e496-61ad-43f0-8ca1-04286030fee8 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:43.379597 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70897e1b-4242-4f84-9840-93beae9f2f7a", "name": "network-vif-deleted", "tag": "89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:43.379888 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-38e5e496-61ad-43f0-8ca1-04286030fee8 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:43.380336 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70897e1b-4242-4f84-9840-93beae9f2f7a', 'name': 'network-vif-deleted', 'tag': '89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9', 'status': 'completed', 'code': 200}
Jun 01 18:55:43.386732 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bfc6cdca-493b-4912-a59c-9dc7b93e8139 req-3993bbca-2c25-4816-8128-d26db68bb871 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1346087
Jun 01 18:55:43.781562 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-6ab0cf77-bde8-4d91-8981-572931e21ac0 req-034f0777-cb84-4d28-91dd-57b050e43ec9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Synchronizing usage tracker for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:43.799576 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-6ab0cf77-bde8-4d91-8981-572931e21ac0 req-034f0777-cb84-4d28-91dd-57b050e43ec9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Unset dirty status for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:43.800846 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6ab0cf77-bde8-4d91-8981-572931e21ac0 req-034f0777-cb84-4d28-91dd-57b050e43ec9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=70897e1b-4242-4f84-9840-93beae9f2f7a HTTP/1.1" status: 200  len: 210 time: 0.0644281
Jun 01 18:55:43.833227 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e101c99c-4312-41b0-aaee-eedca1e2b6c5 req-76239484-1798-4082-862c-05fbcff20dcc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:43.834693 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e101c99c-4312-41b0-aaee-eedca1e2b6c5 req-76239484-1798-4082-862c-05fbcff20dcc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.0932636
Jun 01 18:55:43.882543 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e101c99c-4312-41b0-aaee-eedca1e2b6c5 req-19002cfe-38e4-4bdf-8eb8-c4ab7982362f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419786
Jun 01 18:55:44.141581 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-98f0f65d-84fa-4d89-86cb-76b4c99802f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:45.077450 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77752703-7837-4789-bdda-82088cfccc2b req-07395b3b-6ebb-4f15-bcfe-812ea7988779 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:45.079059 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-77752703-7837-4789-bdda-82088cfccc2b req-07395b3b-6ebb-4f15-bcfe-812ea7988779 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.0867219
Jun 01 18:55:45.127447 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-77752703-7837-4789-bdda-82088cfccc2b req-830783b9-19ed-4116-9a4c-36908c7c5b24 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421455
Jun 01 18:55:45.259190 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-47cdc9dc-6a22-4985-80f8-f476e9ae77c1 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:45.260701 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-47cdc9dc-6a22-4985-80f8-f476e9ae77c1 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 808 time: 0.2465978
Jun 01 18:55:45.276667 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-2eb587fd-fa0d-484c-a8b7-e6c70d1ae0b3 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/quotas/34d11de3d1ac487f94f3c3470921262e HTTP/1.1" status: 200  len: 375 time: 0.0096295
Jun 01 18:55:45.323504 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-daeb9fdb-22c4-4473-b5b8-128e2ea655fb tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0415730
Jun 01 18:55:45.459669 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-78ef49c2-0543-48ee-a476-e1703f8517a1 service neutron] 10.222.0.22 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1287689
Jun 01 18:55:45.591912 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-5689af73-541a-4d7a-b552-f40bc5c39e16 service neutron] 10.222.0.22 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1263907
Jun 01 18:55:45.770125 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5a63e5ae-8dcb-4ac6-90a7-599c33c8a22d req-e4dddd70-9fee-4818-afed-8c3f587b91e1 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 210 time: 0.0481880
Jun 01 18:55:46.329512 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ccd8e7-c02e-4380-8ac6-602e7eeef7a2 req-4b7eeefb-17ef-48bd-8770-f5b4885b8846 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:46.331197 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-87ccd8e7-c02e-4380-8ac6-602e7eeef7a2 req-4b7eeefb-17ef-48bd-8770-f5b4885b8846 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.0959616
Jun 01 18:55:46.375878 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-87ccd8e7-c02e-4380-8ac6-602e7eeef7a2 req-51149089-392b-4721-a07d-6c1dc1abdc9e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390918
Jun 01 18:55:46.730150 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-092e0a84-4daf-4366-85ca-bacebe187d96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:46.822320 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:55:46.889470 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:55:46.890518 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 89b8e17e-2fa7-4f1c-b1f0-66cc398c54a9 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:55:46.902004 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:46.958281 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ccfa31fe-e9e5-434b-ba6d-0647c239d160 req-3a096d2e-d02e-4298-9f80-07e5fef896d2 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 210 time: 0.0563791
Jun 01 18:55:46.986180 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-35cc22d6-5d78-450f-b2b8-b4f678009f87 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:46.987908 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-35cc22d6-5d78-450f-b2b8-b4f678009f87 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 808 time: 0.3187973
Jun 01 18:55:47.002210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Request body: {'port': {'device_id': '3689fb46-7525-4765-af6b-13d915fa11af', 'network_id': '65e659a7-3525-4957-828a-0336c8c79517', 'admin_state_up': True, 'tenant_id': '34d11de3d1ac487f94f3c3470921262e'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:47.138432 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:47.149233 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:47.159659 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Made reservation on behalf of 34d11de3d1ac487f94f3c3470921262e for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:55:47.163160 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:47.332516 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Allocated IP 172.20.0.3 (65e659a7-3525-4957-828a-0336c8c79517/b7838170-f75b-4303-992d-737ef73a33bc/b8d8737c-99fa-4444-b5e0-5ed0abdefd53) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:55:47.535910 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:47.562842 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ad327a2-0211-4e8a-957f-03b22333cba6 req-b7d2b249-8854-46d7-bf23-9d30eed6280b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:47.564616 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8ad327a2-0211-4e8a-957f-03b22333cba6 req-b7d2b249-8854-46d7-bf23-9d30eed6280b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.0821719
Jun 01 18:55:47.566622 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:47.572364 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a4e-a56d-4470-bb16-204ca9bbe2a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:47.614304 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-8ad327a2-0211-4e8a-957f-03b22333cba6 req-99596ed3-4af6-4599-a6b4-0886318a136b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437057
Jun 01 18:55:47.642411 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Network 65e659a7-3525-4957-828a-0336c8c79517 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:55:47.645615 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:47.649709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:55:47.680125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Pushing event updated for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:47.686574 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:47.715847 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:47.716467 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:47.739507 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-4b0df9d4-d4d4-4c1f-84c3-7b481283781a tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7421100
Jun 01 18:55:47.761726 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Request body: {'port': {'device_id': '3689fb46-7525-4765-af6b-13d915fa11af', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:47.827180 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:47.879004 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.235128 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0560af58-51e9-4aa4-b352-3dc858c8a2a8 req-04955575-516f-42f2-88a8-07ccc903a215 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:48.235874 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-0560af58-51e9-4aa4-b352-3dc858c8a2a8 req-04955575-516f-42f2-88a8-07ccc903a215 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Synchronizing usage tracker for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:48.300943 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b8d8737c-99fa-4444-b5e0-5ed0abdefd53 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:48.307031 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-0560af58-51e9-4aa4-b352-3dc858c8a2a8 req-04955575-516f-42f2-88a8-07ccc903a215 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Unset dirty status for tenant:34d11de3d1ac487f94f3c3470921262e on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:48.308200 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0560af58-51e9-4aa4-b352-3dc858c8a2a8 req-04955575-516f-42f2-88a8-07ccc903a215 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 931 time: 0.1991019
Jun 01 18:55:48.309759 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.343225 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Transition to ACTIVE for port object b8d8737c-99fa-4444-b5e0-5ed0abdefd53 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:55:48.353784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.361488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8aa22a3b-3690-4b1e-8edf-a0469e69fe31 tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:48.411749 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0560af58-51e9-4aa4-b352-3dc858c8a2a8 req-7f2e842a-72d5-44dc-9853-34fd883464fc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0969069
Jun 01 18:55:48.490249 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Pushing event updated for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:48.493533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:48.607784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Attempting to bind port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:55:48.608107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Attempting to bind port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:55:48.608454 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Attempting to bind port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 on network 65e659a7-3525-4957-828a-0336c8c79517 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:48.613372 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 on network 65e659a7-3525-4957-828a-0336c8c79517 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:55:48.613689 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Attempting to bind port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 on network 65e659a7-3525-4957-828a-0336c8c79517 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:55:48.618791 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 55, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:55:48.619151 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Checking segment: {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:55:48.619529 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Bound using segment: {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:55:48.619963 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Bound port: b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b468d7ce-aba1-4f29-a82c-41a02585c79c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 93, 'network_id': '65e659a7-3525-4957-828a-0336c8c79517'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:55:48.620320 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.709103 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:55:48.711981 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:55:48.716958 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.721701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-080c442f-d94a-4d43-ad35-c06ace79f72a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:48.808968 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:48.809816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:48.812145 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] 10.222.0.25 "PUT /v2.0/ports/b8d8737c-99fa-4444-b5e0-5ed0abdefd53 HTTP/1.1" status: 200  len: 1093 time: 1.0545835
Jun 01 18:55:48.812761 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:48.815117 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-904e5e7a-573a-41af-90a9-fbb0951be7d0" -d '{"events": [{"name": "network-changed", "server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:48.829942 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099ab8dd-a90d-42fb-9837-0de222890440 req-5a70cff3-3c4d-4bef-939f-b1b63208b3a8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:48.832746 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Pushing event updated for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:48.835534 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:48.836927 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-099ab8dd-a90d-42fb-9837-0de222890440 req-5a70cff3-3c4d-4bef-939f-b1b63208b3a8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.1141644
Jun 01 18:55:48.886174 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-099ab8dd-a90d-42fb-9837-0de222890440 req-8371ef0d-8aef-4c53-ba01-aafab95f3a86 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442474
Jun 01 18:55:48.888170 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a417ce4-0dd4-481e-b06d-385aba7634d4 x-openstack-request-id: req-6a417ce4-0dd4-481e-b06d-385aba7634d4 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:48.888533 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:48.888830 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-6a417ce4-0dd4-481e-b06d-385aba7634d4 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:48.889298 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53', 'status': 'completed', 'code': 200}
Jun 01 18:55:48.933261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-eb5765e1-cac3-462d-8af9-b2c6fc2e094c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:48.937175 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-eb5765e1-cac3-462d-8af9-b2c6fc2e094c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 1096 time: 0.0817239
Jun 01 18:55:49.102583 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-9a9c6c55-02e3-4b41-b941-ca39762bb1e4 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53 HTTP/1.1" status: 200  len: 217 time: 0.1560354
Jun 01 18:55:49.165175 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-f4b53be2-25b1-4dcf-9308-5ab823efc3a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:49.166591 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-f4b53be2-25b1-4dcf-9308-5ab823efc3a7 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b7838170-f75b-4303-992d-737ef73a33bc HTTP/1.1" status: 200  len: 848 time: 0.0575302
Jun 01 18:55:49.216825 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-75674400-332e-406c-86a2-a1de1214ccfd service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=65e659a7-3525-4957-828a-0336c8c79517&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0428145
Jun 01 18:55:49.351755 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-36530432-fcd1-483b-873c-9d20066d240b service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1276505
Jun 01 18:55:49.496399 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f8d5b23f-78a3-4d1a-85c2-6920aa181ca1 req-64dae72a-6c4b-42e3-b6c9-edf375c3de12 service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1369228
Jun 01 18:55:49.539356 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:49.666557 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-87e8bc72-66e8-4c49-b0be-5954fe52b61d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:49.668019 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-87e8bc72-66e8-4c49-b0be-5954fe52b61d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=34d11de3d1ac487f94f3c3470921262e&device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 1096 time: 0.1041975
Jun 01 18:55:49.676548 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac4332e-8d8f-4d1d-b543-d17b013134e2 req-bfbf48db-6ee8-4c30-821c-b71e79662e1b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:49.677977 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9ac4332e-8d8f-4d1d-b543-d17b013134e2 req-bfbf48db-6ee8-4c30-821c-b71e79662e1b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 943 time: 0.1470885
Jun 01 18:55:49.815207 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9ac4332e-8d8f-4d1d-b543-d17b013134e2 req-b3dbafca-21a0-48fe-bbe0-698856f5338f tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1162910
Jun 01 18:55:49.844641 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-89de0695-bd16-4b78-9a30-d4d726be1753 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:49.846081 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-89de0695-bd16-4b78-9a30-d4d726be1753 service neutron] 10.222.0.25 "GET /v2.0/networks?id=65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 200  len: 908 time: 0.1672337
Jun 01 18:55:49.917896 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-0e525b1a-0484-41bb-8754-b4473e446319 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53 HTTP/1.1" status: 200  len: 217 time: 0.0639734
Jun 01 18:55:49.979869 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-cfae60d3-8eaa-4bf6-8130-79fbe94d1e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:49.981312 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-cfae60d3-8eaa-4bf6-8130-79fbe94d1e24 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b7838170-f75b-4303-992d-737ef73a33bc HTTP/1.1" status: 200  len: 848 time: 0.0565851
Jun 01 18:55:50.035159 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-e159135a-7f78-4beb-873f-a95b16e29794 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=65e659a7-3525-4957-828a-0336c8c79517&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0458941
Jun 01 18:55:50.084670 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f44a9686-5394-43da-8d6b-1d0a667f1498 req-b65f46e7-e761-4e08-ba9d-d33b145804c8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:50.086135 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f44a9686-5394-43da-8d6b-1d0a667f1498 req-b65f46e7-e761-4e08-ba9d-d33b145804c8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 944 time: 0.0938909
Jun 01 18:55:50.132071 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f44a9686-5394-43da-8d6b-1d0a667f1498 req-8771f8e8-8548-4ee5-8cd6-126a4be5beff tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393724
Jun 01 18:55:50.172720 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-0481e556-475f-4836-842f-d2a4e711d054 service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1282930
Jun 01 18:55:50.301830 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-904e5e7a-573a-41af-90a9-fbb0951be7d0 req-78696f43-34bd-4bbb-957e-738c7b39ef82 service neutron] 10.222.0.25 "GET /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1233981
Jun 01 18:55:50.824357 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ef46ff60-b962-43c5-bb89-c3d73b4dd406 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:55:50.957457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:50.970235 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 81, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:55:51.001595 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44279822-fafe-472f-8115-ebedaecedefe req-34e85969-592c-46d6-a1c6-cae6a76347cd tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:51.003538 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-44279822-fafe-472f-8115-ebedaecedefe req-34e85969-592c-46d6-a1c6-cae6a76347cd tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 943 time: 0.0845087
Jun 01 18:55:51.025952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:51.042314 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ef46ff60-b962-43c5-bb89-c3d73b4dd406 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:51.048279 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-44279822-fafe-472f-8115-ebedaecedefe req-76d73a06-f2a7-4f5a-b8e3-e4eb5e20d869 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390437
Jun 01 18:55:51.059884 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:51.070278 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:51.072142 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:51.138132 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:51.141455 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:51.320039 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f897b7-e37d-4b05-9c04-a890ee784d1a req-300bf5f2-79f9-4f4f-8b9b-b10dc623766f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:51.321615 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-68f897b7-e37d-4b05-9c04-a890ee784d1a req-300bf5f2-79f9-4f4f-8b9b-b10dc623766f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 945 time: 0.0844469
Jun 01 18:55:51.327104 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['ef46ff60-b962-43c5-bb89-c3d73b4dd406'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:55:51.367982 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-68f897b7-e37d-4b05-9c04-a890ee784d1a req-e669c1bc-daa7-4ced-9fed-a63de53236f4 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408239
Jun 01 18:55:52.232540 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-076338be-8be8-4647-a56f-7bef6cb7626c req-46c9f017-8fdc-486a-8500-27a4470de389 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:52.233992 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-076338be-8be8-4647-a56f-7bef6cb7626c req-46c9f017-8fdc-486a-8500-27a4470de389 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 943 time: 0.0808730
Jun 01 18:55:52.278511 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-076338be-8be8-4647-a56f-7bef6cb7626c req-cfaaa369-f131-43f7-a4a4-4371874a97ea tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384364
Jun 01 18:55:52.555930 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-811065e8-1e45-4762-b565-bf7210046f69 req-d01d176a-72b6-42b0-896e-26ff49d7630e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:52.557386 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-811065e8-1e45-4762-b565-bf7210046f69 req-d01d176a-72b6-42b0-896e-26ff49d7630e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 945 time: 0.0829110
Jun 01 18:55:52.600338 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-811065e8-1e45-4762-b565-bf7210046f69 req-6ac8e314-d426-4b95-80de-14d57d552a3a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0373845
Jun 01 18:55:52.838060 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b8d8737c-99fa-4444-b5e0-5ed0abdefd53 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:55:52.841453 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ef46ff60-b962-43c5-bb89-c3d73b4dd406 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:55:52.994651 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port ef46ff60-b962-43c5-bb89-c3d73b4dd406 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:55:53.008230 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port ef46ff60-b962-43c5-bb89-c3d73b4dd406 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:55:53.008638 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:53.068447 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:53.087252 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53', 'network_id': '65e659a7-3525-4957-828a-0336c8c79517', 'port_id': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53', 'mac_address': 'fa:16:3e:8c:f7:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 93, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b7838170-f75b-4303-992d-737ef73a33bc', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:55:53.181149 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:53.209971 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8d8737c-99fa-4444-b5e0-5ed0abdefd53 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:55:53.217980 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:53.240301 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:53.246532 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:53.248842 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-f2d233d4-0e6f-4762-b62d-0b2ed9331ffb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:53.288903 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:53.291100 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04cb27cb-d49b-44fe-afae-c3d4f225cd7e" -d '{"events": [{"server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "name": "network-vif-plugged", "status": "completed", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:53.311566 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:53.322419 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:53.332939 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:53.335889 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:53.336396 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:53.366497 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa05887b-dc4c-466d-8510-8ca685fad21e x-openstack-request-id: req-fa05887b-dc4c-466d-8510-8ca685fad21e {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:53.366792 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "name": "network-vif-plugged", "status": "completed", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:53.367054 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-fa05887b-dc4c-466d-8510-8ca685fad21e {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:53.367452 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'code': 200}
Jun 01 18:55:53.405843 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:53.408984 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:53.471134 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5b8363-085f-4447-9f2c-e33a238fc878 req-dcfbcecc-eef6-45df-8b56-1f0d456db71b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:53.472706 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5d5b8363-085f-4447-9f2c-e33a238fc878 req-dcfbcecc-eef6-45df-8b56-1f0d456db71b tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 944 time: 0.0831811
Jun 01 18:55:53.517770 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['b8d8737c-99fa-4444-b5e0-5ed0abdefd53'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:55:53.519053 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5d5b8363-085f-4447-9f2c-e33a238fc878 req-dae4a5da-9c4c-49c1-a93c-e34aedbc43a5 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406787
Jun 01 18:55:53.640979 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8be086-e5e0-487b-93da-9c7645273c33 req-5619a37f-5ce9-49e4-8e82-1cecef2cd97e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:53.642462 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1e8be086-e5e0-487b-93da-9c7645273c33 req-5619a37f-5ce9-49e4-8e82-1cecef2cd97e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1099 time: 0.0710764
Jun 01 18:55:53.823314 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-1e8be086-e5e0-487b-93da-9c7645273c33 req-62da5a75-441a-401f-b0ca-7842486a7ced service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1740773
Jun 01 18:55:53.861379 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20b6c98-c8e4-4760-bf8a-46c3428ba519 req-4b8d77f8-7b21-4c6c-a659-9adb6465f6a7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:53.862995 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c20b6c98-c8e4-4760-bf8a-46c3428ba519 req-4b8d77f8-7b21-4c6c-a659-9adb6465f6a7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.0838785
Jun 01 18:55:53.906753 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c20b6c98-c8e4-4760-bf8a-46c3428ba519 req-8a2fb862-bd66-4f77-ad45-7eb909343517 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377359
Jun 01 18:55:54.708909 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc78108-4c7b-42a8-8146-a253cb5bf9ae req-96e35b28-6a3c-4c50-9d57-e056e08436d3 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:54.710345 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9fc78108-4c7b-42a8-8146-a253cb5bf9ae req-96e35b28-6a3c-4c50-9d57-e056e08436d3 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 944 time: 0.0855865
Jun 01 18:55:54.754031 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-9fc78108-4c7b-42a8-8146-a253cb5bf9ae req-eafe25b5-f6cc-476e-b8ee-6436c47ee2a7 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380189
Jun 01 18:55:54.855364 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b8d8737c-99fa-4444-b5e0-5ed0abdefd53 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:55:54.921522 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:55:54.926169 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:55:54.926576 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:55.077916 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:55.098985 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec8af887-0e83-4e6a-b9de-1289e7a7a729 req-615bee31-40f2-461b-b8d6-7124ab4d9e8a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:55.100461 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec8af887-0e83-4e6a-b9de-1289e7a7a729 req-615bee31-40f2-461b-b8d6-7124ab4d9e8a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.0834379
Jun 01 18:55:55.111703 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:55:55.116042 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:55.118096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:55.147428 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ec8af887-0e83-4e6a-b9de-1289e7a7a729 req-af8bc691-cb25-44e0-9951-851114644e54 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407543
Jun 01 18:55:55.191952 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:55.201531 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:55.340657 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d52ae2-a302-48c3-8062-21d64a8488df req-0a5370b8-56c3-4f09-85b8-f14370c6487d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:55.344985 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-02d52ae2-a302-48c3-8062-21d64a8488df req-0a5370b8-56c3-4f09-85b8-f14370c6487d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.0864027
Jun 01 18:55:55.368351 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:55.370747 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-950dca34-1bfe-410f-9adf-5e40abfcea89" -d '{"events": [{"server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:55.390322 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-02d52ae2-a302-48c3-8062-21d64a8488df req-3a0a40df-c572-4db3-b357-bfff3a44b6e6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423887
Jun 01 18:55:55.415660 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 41552) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:55.427349 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2201f13e-c1b9-4b23-a1ee-a1101457c6ca x-openstack-request-id: req-2201f13e-c1b9-4b23-a1ee-a1101457c6ca {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:55.427913 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:55.428277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-2201f13e-c1b9-4b23-a1ee-a1101457c6ca {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:55.428888 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53', 'code': 200}
Jun 01 18:55:55.503301 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aabd071d-15ef-462f-8688-dd21368ad77e tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:55.503998 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-aabd071d-15ef-462f-8688-dd21368ad77e tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] Synchronizing usage tracker for tenant:c475e7accec74e35aa5db988675335f7 on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:55:55.521607 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-aabd071d-15ef-462f-8688-dd21368ad77e tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] Unset dirty status for tenant:c475e7accec74e35aa5db988675335f7 on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:55:55.522986 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-aabd071d-15ef-462f-8688-dd21368ad77e tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1094 time: 0.1062889
Jun 01 18:55:55.526098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41554) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:55:55.530935 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address': '172.20.0.10'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:55:55.537641 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:55:55.542164 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:floatingip and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:55:55.545701 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:55:55.551923 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:55:55.566994 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:55.745720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f936a15-c1fb-4a47-b2cb-19cb84e8cde6 req-7ed1df2f-99b4-41fe-9961-1d58441b3095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:55.747214 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f936a15-c1fb-4a47-b2cb-19cb84e8cde6 req-7ed1df2f-99b4-41fe-9961-1d58441b3095 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 1098 time: 0.1433847
Jun 01 18:55:55.801046 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:55.803718 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9f936a15-c1fb-4a47-b2cb-19cb84e8cde6 req-d1933cf4-c2ae-41b2-8495-5d932084038e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488806
Jun 01 18:55:56.008354 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.27.0.188 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/a1b5fb53-d2a3-45d1-82e0-292955093602) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:55:56.022374 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca3ad2a-88a0-4569-a2b2-3a6886c975cb req-e5480ffb-64f6-4004-a98b-9bb330c8711f tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:56.023829 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ca3ad2a-88a0-4569-a2b2-3a6886c975cb req-e5480ffb-64f6-4004-a98b-9bb330c8711f tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 945 time: 0.1664798
Jun 01 18:55:56.152565 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7ca3ad2a-88a0-4569-a2b2-3a6886c975cb req-617f5352-627e-47f5-9af6-4e30cb5a0095 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1222236
Jun 01 18:55:56.198106 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:56.226410 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:56.229793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-29231f22-ead8-4529-82e5-022fc1dceb26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:56.293159 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:55:56.295900 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:55:56.300611 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:55:56.329695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=a1b5fb53-d2a3-45d1-82e0-292955093602,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:56.335451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:56.709139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:56.790451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:57.080908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:57.085184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:57.089456 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-b13bbc7e-5e29-48a9-98ae-e3ffd1c4a713 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:55:57.209055 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=a1b5fb53-d2a3-45d1-82e0-292955093602,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:55:57.213236 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:55:57.218269 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:57.342819 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7f092f-13c0-4ef5-aec5-93e84ab3900f req-99cd053b-9062-496a-aa28-2175cda22776 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:57.344156 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4d7f092f-13c0-4ef5-aec5-93e84ab3900f req-99cd053b-9062-496a-aa28-2175cda22776 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 945 time: 0.0824304
Jun 01 18:55:57.388301 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4d7f092f-13c0-4ef5-aec5-93e84ab3900f req-c9844a48-b333-4cf6-9aad-7f0adc5cf8ff tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382993
Jun 01 18:55:57.390818 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba associated. External IP: 172.27.0.188, port: ef46ff60-b962-43c5-bb89-c3d73b4dd406.
Jun 01 18:55:57.739370 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:55:57.920244 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:55:57.930799 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:55:57.942023 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:55:57.942826 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc424f0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:55:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:57.944638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:55:57.998577 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.4712551
Jun 01 18:55:57.999229 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:55:58.001575 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e584987c-7438-4c0e-9288-37051a0a367c" -d '{"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:55:58.044635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:55:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6314ef1-40eb-424e-812a-dc1e8a425e86 x-openstack-request-id: req-e6314ef1-40eb-424e-812a-dc1e8a425e86 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:55:58.045306 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:55:58.045788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e6314ef1-40eb-424e-812a-dc1e8a425e86 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:55:58.046357 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'status': 'completed', 'code': 200}
Jun 01 18:55:58.127699 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:55:58.158745 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e584987c-7438-4c0e-9288-37051a0a367c req-4f26eebd-cf6f-4ab7-b50e-02a44b073105 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:58.160245 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-4f26eebd-cf6f-4ab7-b50e-02a44b073105 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1099 time: 0.0837281
Jun 01 18:55:58.297290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e584987c-7438-4c0e-9288-37051a0a367c req-552f8bff-8759-4aab-80d8-7c36ad45d0b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:58.298852 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-552f8bff-8759-4aab-80d8-7c36ad45d0b2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1305878
Jun 01 18:55:58.410924 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-30ef1d7b-d845-4ead-a0cc-8b3009377367 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 1000 time: 0.1046739
Jun 01 18:55:58.487350 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc424f0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:56Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:58.491521 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:55:58.500792 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:55:58.501427 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc424f0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:55:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:58.628886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e584987c-7438-4c0e-9288-37051a0a367c req-042cb383-3be6-4af1-8665-1bc113704573 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:58.630305 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-042cb383-3be6-4af1-8665-1bc113704573 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.2119372
Jun 01 18:55:58.678438 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:55:58.699275 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c30b71f-4fcb-4dd6-b97a-9d485e42187b req-b02cd8b8-dbef-417e-ab61-e2233b76f3dc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:58.700735 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4c30b71f-4fcb-4dd6-b97a-9d485e42187b req-b02cd8b8-dbef-417e-ab61-e2233b76f3dc tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 945 time: 0.1446419
Jun 01 18:55:58.756034 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-4c30b71f-4fcb-4dd6-b97a-9d485e42187b req-5dbe53c4-f835-463b-9fc9-56492e4ab811 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0486143
Jun 01 18:55:58.761520 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e584987c-7438-4c0e-9288-37051a0a367c req-427f58e5-7743-4767-ae64-cd33babbe4a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:58.767427 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-427f58e5-7743-4767-ae64-cd33babbe4a1 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1254327
Jun 01 18:55:58.897197 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-73cda0df-74a1-499f-b533-71fe43aed87d service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1260877
Jun 01 18:55:59.028349 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e584987c-7438-4c0e-9288-37051a0a367c req-dff8d566-ffba-44db-b24f-f9c3bb311f69 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1233428
Jun 01 18:55:59.033800 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc424f0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:56Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:55:59.037948 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58cdc917-a73d-4553-921b-8cce0320f182 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:56Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:55:59.214802 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbd7c5c-7aa7-49f2-bee8-9177045b7cf3 None None] New status for floating IP 995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:55:59.821723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3491bece-658c-4adf-945e-e921f7a81415 req-5ec5d935-e3c2-402d-82eb-093e9b1ce213 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:59.823174 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3491bece-658c-4adf-945e-e921f7a81415 req-5ec5d935-e3c2-402d-82eb-093e9b1ce213 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 945 time: 0.0900671
Jun 01 18:55:59.951657 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388e3146-6a36-4882-93bb-f83743875bd5 req-5ba46428-5615-495a-98bb-3303e664edd5 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:55:59.953191 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-388e3146-6a36-4882-93bb-f83743875bd5 req-5ba46428-5615-495a-98bb-3303e664edd5 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/ports?device_id=3689fb46-7525-4765-af6b-13d915fa11af HTTP/1.1" status: 200  len: 945 time: 0.0795941
Jun 01 18:55:59.962116 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Deleting port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:55:59.962461 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:00.001532 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-388e3146-6a36-4882-93bb-f83743875bd5 req-cd61f1f3-b0da-4e72-8f0a-82db3700e3b0 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.22 "GET /v2.0/security-groups?id=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424035
Jun 01 18:56:00.097045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] For port b8d8737c-99fa-4444-b5e0-5ed0abdefd53, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,segment=NetworkSegment(b468d7ce-aba1-4f29-a82c-41a02585c79c),segment_id=b468d7ce-aba1-4f29-a82c-41a02585c79c)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:00.097325 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:00.216218 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Calling delete_port for b8d8737c-99fa-4444-b5e0-5ed0abdefd53 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:56:00.323774 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:00.330943 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5d098594-7254-4f48-a66a-6348503ee69e tempest-TestMinimumBasicScenario-222199934 tempest-TestMinimumBasicScenario-222199934-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:00.336625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['b8d8737c-99fa-4444-b5e0-5ed0abdefd53'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:56:00.410769 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Pushing event deleted for resources: {'Port': ['ID=b8d8737c-99fa-4444-b5e0-5ed0abdefd53,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:00.413008 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:00.450711 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] No DVR routers for this DVR port b8d8737c-99fa-4444-b5e0-5ed0abdefd53 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:56:00.453870 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:00.456285 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'name': 'network-vif-deleted', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:00.458525 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-738997c0-b14e-4f56-b7a6-83f26a450bec" -d '{"events": [{"server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "name": "network-vif-deleted", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:00.472101 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3491bece-658c-4adf-945e-e921f7a81415 req-12427cc3-cf33-4925-ae9d-8ed795c54bd9 tempest-VolumesActionsTest-1964164690 tempest-VolumesActionsTest-1964164690-project] 10.222.0.25 "DELETE /v2.0/ports/b8d8737c-99fa-4444-b5e0-5ed0abdefd53 HTTP/1.1" status: 204  len: 173 time: 0.6420102
Jun 01 18:56:00.499314 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c1b7e45-f445-4153-9e01-aa416485ef54 x-openstack-request-id: req-7c1b7e45-f445-4153-9e01-aa416485ef54 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:00.499651 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3689fb46-7525-4765-af6b-13d915fa11af", "name": "network-vif-deleted", "tag": "b8d8737c-99fa-4444-b5e0-5ed0abdefd53", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:00.499959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7c1b7e45-f445-4153-9e01-aa416485ef54 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:00.500419 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3689fb46-7525-4765-af6b-13d915fa11af', 'name': 'network-vif-deleted', 'tag': 'b8d8737c-99fa-4444-b5e0-5ed0abdefd53', 'status': 'completed', 'code': 200}
Jun 01 18:56:03.524139 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b8d8737c-99fa-4444-b5e0-5ed0abdefd53 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:56:03.557855 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: b8d8737c-99fa-4444-b5e0-5ed0abdefd53 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:56:03.558198 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device b8d8737c-99fa-4444-b5e0-5ed0abdefd53 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:56:10.858702 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:14.144609 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7ff27b26-3199-4f54-85e7-6b5adcbb99c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:14.220289 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:56:16.733590 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-956f5d23-69c0-4ade-8242-dc7639dd4f55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:16.881043 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:17.840272 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:19.547458 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:24.133704 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3fceb0-c92c-4446-b171-9fdfc533b7f7 req-b6d07c9b-0324-4a4a-8073-ba50d195e7ff tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:24.135160 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ac3fceb0-c92c-4446-b171-9fdfc533b7f7 req-b6d07c9b-0324-4a4a-8073-ba50d195e7ff tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 946 time: 0.0834327
Jun 01 18:56:24.180005 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ac3fceb0-c92c-4446-b171-9fdfc533b7f7 req-5dd1cb1e-b11e-4cc3-a6ac-adaec99442ef tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382586
Jun 01 18:56:25.373790 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39719de-f533-41ad-b6f5-c50b06fccee1 req-959822f2-ab45-48f5-aae6-e86126d43cb0 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:25.375268 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a39719de-f533-41ad-b6f5-c50b06fccee1 req-959822f2-ab45-48f5-aae6-e86126d43cb0 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 946 time: 0.0845931
Jun 01 18:56:25.423343 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a39719de-f533-41ad-b6f5-c50b06fccee1 req-ba741eac-97a1-42e1-a901-51a589da6fcb tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420172
Jun 01 18:56:25.778419 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-07a87334-69f5-4064-830c-d1db5ddd3e0c tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:25.779916 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-07a87334-69f5-4064-830c-d1db5ddd3e0c tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 946 time: 0.0789673
Jun 01 18:56:25.917938 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Deleting port 5558d8fb-a66c-435c-93bf-a6359b033722 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:56:25.918284 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.133720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] For port 5558d8fb-a66c-435c-93bf-a6359b033722, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5558d8fb-a66c-435c-93bf-a6359b033722,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:26.134081 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.258556 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Calling delete_port for 5558d8fb-a66c-435c-93bf-a6359b033722 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:56:26.367640 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.373577 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ca368701-f65a-4fa7-828f-d961e5527d0e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:26.383394 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['5558d8fb-a66c-435c-93bf-a6359b033722'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:56:26.423290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Pushing event deleted for resources: {'Port': ['ID=5558d8fb-a66c-435c-93bf-a6359b033722,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:26.485725 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:26.496606 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] No DVR routers for this DVR port 5558d8fb-a66c-435c-93bf-a6359b033722 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:56:26.499034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.501758 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'name': 'network-vif-deleted', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:26.504017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7947563a-f290-4fa6-a9c0-b573acadc85d" -d '{"events": [{"server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "name": "network-vif-deleted", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:26.518938 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-73a9b350-0b48-4012-afa5-51f77a46bb19 req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "DELETE /v2.0/ports/5558d8fb-a66c-435c-93bf-a6359b033722 HTTP/1.1" status: 204  len: 173 time: 0.7331579
Jun 01 18:56:26.581084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8435f4dc-c8a5-4407-9f94-3ed61046aca0 x-openstack-request-id: req-8435f4dc-c8a5-4407-9f94-3ed61046aca0 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:26.581417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9172fafe-7696-4fc3-823c-487d740931dd", "name": "network-vif-deleted", "tag": "5558d8fb-a66c-435c-93bf-a6359b033722", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:26.581708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-8435f4dc-c8a5-4407-9f94-3ed61046aca0 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:26.582136 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9172fafe-7696-4fc3-823c-487d740931dd', 'name': 'network-vif-deleted', 'tag': '5558d8fb-a66c-435c-93bf-a6359b033722', 'status': 'completed', 'code': 200}
Jun 01 18:56:26.593118 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e3e7f740-515a-4e3f-8674-4bb3f0095cba req-369e0682-2f81-4124-ab53-8bd2dade5840 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Synchronizing usage tracker for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:56:26.608184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-e3e7f740-515a-4e3f-8674-4bb3f0095cba req-369e0682-2f81-4124-ab53-8bd2dade5840 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Unset dirty status for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:56:26.609982 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e3e7f740-515a-4e3f-8674-4bb3f0095cba req-369e0682-2f81-4124-ab53-8bd2dade5840 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=9172fafe-7696-4fc3-823c-487d740931dd HTTP/1.1" status: 200  len: 210 time: 0.0646229
Jun 01 18:56:26.807874 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41920) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:26.868388 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Deleting subnet b7838170-f75b-4303-992d-737ef73a33bc {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:56:26.871182 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.919497 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:26.978414 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.224608 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.228583 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-fad7b1b7-a997-4a85-8886-68da817bdae1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:27.264871 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b7838170-f75b-4303-992d-737ef73a33bc,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:27.269000 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:27.271324 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.277421 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c349d88c-aeba-4d8c-b863-7c9bcc64d7cf admin admin] 10.222.0.22 "DELETE /v2.0/subnets/b7838170-f75b-4303-992d-737ef73a33bc HTTP/1.1" status: 204  len: 168 time: 0.4685013
Jun 01 18:56:27.279829 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41924) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:27.379720 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.501624 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.513380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cc5bba60>,) {'filters': {'network_id': ['65e659a7-3525-4957-828a-0336c8c79517']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:56:27.525405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc5bba60>, 'b468d7ce-aba1-4f29-a82c-41a02585c79c') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:56:27.525692 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc5bba60>, 'b468d7ce-aba1-4f29-a82c-41a02585c79c') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:56:27.536722 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.552824 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.558657 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Releasing vlan 93 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:56:27.559034 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:56:27.572264 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:56:27.646928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.652666 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:27.676521 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.696553 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Pushing event deleted for resources: {'Network': ['ID=65e659a7-3525-4957-828a-0336c8c79517,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:27.701657 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:27.707911 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-b77860c2-7da5-4dd3-ab87-79dc3bf083b0 admin admin] 10.222.0.22 "DELETE /v2.0/networks/65e659a7-3525-4957-828a-0336c8c79517 HTTP/1.1" status: 204  len: 168 time: 0.4271920
Jun 01 18:56:27.826481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41932) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:27.877100 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-11840bd7-7f3b-42ae-8e41-ab12bf2afe77 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=34d11de3d1ac487f94f3c3470921262e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0492766
Jun 01 18:56:27.879488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 41934) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:27.937266 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:27.967671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:28.019062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:28.023925 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8cb5a3e0-9e34-4f3f-87cf-51bc5ff44393 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:28.038703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7eb2bf0-b911-488d-ae3a-3f3eccc1df73,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:28.046449 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:28.049512 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:28.050671 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-561ca7e9-4a92-41b8-84c9-e2d8599b8381 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/e7eb2bf0-b911-488d-ae3a-3f3eccc1df73 HTTP/1.1" status: 204  len: 168 time: 0.1702676
Jun 01 18:56:29.160218 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5558d8fb-a66c-435c-93bf-a6359b033722 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:56:29.204958 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 5558d8fb-a66c-435c-93bf-a6359b033722 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:56:29.205312 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5558d8fb-a66c-435c-93bf-a6359b033722 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:56:31.689815 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-6706fc60-a23e-4b92-8def-5ed2cb105c9e tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/networks?tenant_id=4118ca0d60b9458c82ba995083573caf&shared=False HTTP/1.1" status: 200  len: 213 time: 0.1174469
Jun 01 18:56:31.836594 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-a0833b06-291b-4ee3-b8dc-4de1e68d63f5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:31.838004 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-a0833b06-291b-4ee3-b8dc-4de1e68d63f5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1428552
Jun 01 18:56:31.852738 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-620bfd69-629a-4903-9704-597fa3163d51 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/quotas/4118ca0d60b9458c82ba995083573caf HTTP/1.1" status: 200  len: 375 time: 0.0087771
Jun 01 18:56:31.897835 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-0f282007-c852-4ebf-9dd4-795525830a6c tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=4118ca0d60b9458c82ba995083573caf&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0403292
Jun 01 18:56:32.074783 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-6cd181d5-03b4-4623-9a13-bbed82510e5e req-2996578e-b630-4f80-bfb6-794963cd0506 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 210 time: 0.0452335
Jun 01 18:56:33.064185 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-ac50b91a-e3a3-46ed-9e34-1ca179f3cb2c tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=4118ca0d60b9458c82ba995083573caf&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0269685
Jun 01 18:56:33.252119 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-f365b5ea-afb7-4bac-82e8-687e741e30c0 req-b2495b2a-43a4-449c-9949-0eb998afa41c tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 210 time: 0.0643854
Jun 01 18:56:33.260519 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-442d6421-b648-4ba9-96df-4f8869883f49 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:33.261911 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-442d6421-b648-4ba9-96df-4f8869883f49 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1909153
Jun 01 18:56:33.283115 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Request body: {'port': {'device_id': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed', 'admin_state_up': True, 'tenant_id': '4118ca0d60b9458c82ba995083573caf'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:56:33.416393 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:56:33.420589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Usage tracker for resource:port and tenant:4118ca0d60b9458c82ba995083573caf is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:56:33.423390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:56:33.429043 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:56:33.437589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Made reservation on behalf of 4118ca0d60b9458c82ba995083573caf for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:56:33.441160 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:33.453534 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks [] for security_group, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:33.467834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:56:33.472375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Usage tracker for resource:security_group_rule and tenant:4118ca0d60b9458c82ba995083573caf is out of sync, need to count used quota {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:56:33.475223 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98258) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:56:33.481022 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:56:33.570023 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks [] for security_group, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:33.574358 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:33.579064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dfdb91b5-1b68-4d70-9a56-6360d34a5479 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:33.655188 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2b987c58-bebc-4928-a5f4-899687301e54,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:33.671531 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.671834 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.672210 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.672602 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.672967 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.673327 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.673687 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.674040 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.674398 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.674753 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.675107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.675460 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:33.681721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:33.765792 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Allocated IP 192.168.233.139 (2f9e5c2b-747e-41b7-92e1-40dd1da829ed/651f7706-feb5-49b8-bd41-f9b424b82cd6/0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:56:33.970893 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:33.985520 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Transition to ACTIVE for port object 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:56:34.008359 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:34.013795 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dd38a68c-56fd-42ea-bd3c-017906362741 tempest-TestShelveInstance-246140667 tempest-TestShelveInstance-246140667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:34.078592 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:56:34.081686 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:56:34.085488 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:56:34.115705 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Pushing event updated for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:34.123300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:34.154133 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:34.154750 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:34.181028 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 0.9081578
Jun 01 18:56:34.265264 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-3fb415b2-ff0b-47fc-b616-2f049e019495 None None] Provisioning for port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:56:34.269792 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-3fb415b2-ff0b-47fc-b616-2f049e019495 None None] Provisioning complete for port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:56:34.270167 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3fb415b2-ff0b-47fc-b616-2f049e019495 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:34.325081 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-3fb415b2-ff0b-47fc-b616-2f049e019495 None None] Port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:56:34.434252 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b15859-662b-4507-9b7a-40420cf7b225 req-31173a0a-4615-48ba-9bd0-356bfe7841b9 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:34.435666 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-12b15859-662b-4507-9b7a-40420cf7b225 req-31173a0a-4615-48ba-9bd0-356bfe7841b9 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 936 time: 0.0782731
Jun 01 18:56:34.479694 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-12b15859-662b-4507-9b7a-40420cf7b225 req-15f84221-9b1f-4acf-9931-84fbe86c6870 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379345
Jun 01 18:56:35.661970 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-a6bc2929-63ef-4f74-bd2f-5d9ddf23df41 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:35.662645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-a6bc2929-63ef-4f74-bd2f-5d9ddf23df41 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Synchronizing usage tracker for tenant:4118ca0d60b9458c82ba995083573caf on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:56:35.679062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-a6bc2929-63ef-4f74-bd2f-5d9ddf23df41 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Unset dirty status for tenant:4118ca0d60b9458c82ba995083573caf on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:56:35.680484 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-a6bc2929-63ef-4f74-bd2f-5d9ddf23df41 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 936 time: 0.0986354
Jun 01 18:56:35.724204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-684e51a6-c3a9-4a39-8fe0-a204b2ac29aa tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Synchronizing usage tracker for tenant:4118ca0d60b9458c82ba995083573caf on resource:security_group {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:56:35.740288 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-684e51a6-c3a9-4a39-8fe0-a204b2ac29aa tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Unset dirty status for tenant:4118ca0d60b9458c82ba995083573caf on resource:security_group {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:56:35.741411 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-79d36429-86c5-4cea-ae60-ee04b2415d81 req-684e51a6-c3a9-4a39-8fe0-a204b2ac29aa tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546579
Jun 01 18:56:35.886590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Request body: {'port': {'device_id': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:56:35.995043 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.415298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:56:36.422749 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.436263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Transition to ACTIVE for port object 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:56:36.440933 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.444499 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:36.595914 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Pushing event updated for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:36.603405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:36.675663 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Attempting to bind port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:56:36.676279 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Attempting to bind port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:56:36.676279 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Attempting to bind port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae on network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:56:36.681699 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae on network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:56:36.682024 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Attempting to bind port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae on network 2f9e5c2b-747e-41b7-92e1-40dd1da829ed {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:56:36.687531 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 56, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:56:36.687863 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Checking segment: {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:56:36.688238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Bound using segment: {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:56:36.688688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Bound port: 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cca38853-2470-455c-b471-569f58a7b8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 77, 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:56:36.689031 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.784671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:56:36.787645 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:56:36.792102 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.797264 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d44f70e4-46a2-4372-8699-03dfc4dafd8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:36.861726 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:36.862416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:36.864164 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] 10.222.0.25 "PUT /v2.0/ports/0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae HTTP/1.1" status: 200  len: 1098 time: 0.9817066
Jun 01 18:56:36.864744 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:36.867107 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f58301d-46e1-4d62-8469-1deef89fc875" -d '{"events": [{"name": "network-changed", "server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:36.889104 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Pushing event updated for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:36.892246 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:36.934204 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6bc8ede8-cb80-43a8-8769-12d4351304a1 x-openstack-request-id: req-6bc8ede8-cb80-43a8-8769-12d4351304a1 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:36.934543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:36.934841 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-6bc8ede8-cb80-43a8-8769-12d4351304a1 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:36.935313 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae', 'status': 'completed', 'code': 200}
Jun 01 18:56:36.997342 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de1c7336-9b83-4081-866d-8ed0e597f21c req-3b90237f-3d73-4607-86cc-9bf854c52059 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:36.999207 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-de1c7336-9b83-4081-866d-8ed0e597f21c req-3b90237f-3d73-4607-86cc-9bf854c52059 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 948 time: 0.1502955
Jun 01 18:56:37.031201 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-cf39ff02-ba29-457d-899c-3268674aff1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.032851 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-cf39ff02-ba29-457d-899c-3268674aff1c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4118ca0d60b9458c82ba995083573caf&device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 1101 time: 0.0829940
Jun 01 18:56:37.047146 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-de1c7336-9b83-4081-866d-8ed0e597f21c req-35b98418-6613-4d8d-add1-c4f231fda9f2 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416117
Jun 01 18:56:37.105812 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-0bd6defa-fb09-4056-a9d1-46831a6c018a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.139&port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae HTTP/1.1" status: 200  len: 217 time: 0.0643926
Jun 01 18:56:37.169786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-a6d78fc7-a1c4-493f-8a5a-1217d0e2d33a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.171638 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-a6d78fc7-a1c4-493f-8a5a-1217d0e2d33a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=651f7706-feb5-49b8-bd41-f9b424b82cd6 HTTP/1.1" status: 200  len: 843 time: 0.0595994
Jun 01 18:56:37.247305 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-b69a15f0-d420-443f-9699-5954476f4654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.248722 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-b69a15f0-d420-443f-9699-5954476f4654 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2f9e5c2b-747e-41b7-92e1-40dd1da829ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0673647
Jun 01 18:56:37.391560 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-47c2ee2c-f3df-49c8-852b-dcceac892816 service neutron] 10.222.0.25 "GET /v2.0/networks/2f9e5c2b-747e-41b7-92e1-40dd1da829ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1322086
Jun 01 18:56:37.523361 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae4d2dc0-e0ca-426d-8cab-3778b87568f3 req-9775190e-1b1e-48ad-8ecb-a4d64060c1f8 service neutron] 10.222.0.25 "GET /v2.0/networks/2f9e5c2b-747e-41b7-92e1-40dd1da829ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1208813
Jun 01 18:56:37.651069 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-f902ff6b-57fe-4076-9b0c-c1f8b33cb6a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.652451 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-f902ff6b-57fe-4076-9b0c-c1f8b33cb6a8 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4118ca0d60b9458c82ba995083573caf&device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 1101 time: 0.0735106
Jun 01 18:56:37.784450 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-170b8dad-cfd3-4ae9-8d73-e62676f5f3f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.785927 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-170b8dad-cfd3-4ae9-8d73-e62676f5f3f4 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2f9e5c2b-747e-41b7-92e1-40dd1da829ed HTTP/1.1" status: 200  len: 869 time: 0.1259813
Jun 01 18:56:37.852118 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-ce8c7792-5bd3-4e1c-a441-f6dd46399aa2 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.139&port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae HTTP/1.1" status: 200  len: 217 time: 0.0585396
Jun 01 18:56:37.915088 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-6f61411c-3ae5-433c-bf6c-f081de1b2888 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.916551 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-6f61411c-3ae5-433c-bf6c-f081de1b2888 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=651f7706-feb5-49b8-bd41-f9b424b82cd6 HTTP/1.1" status: 200  len: 843 time: 0.0581889
Jun 01 18:56:37.991417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-01321126-30f1-417e-840d-b8fcd2223358 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:37.992916 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-01321126-30f1-417e-840d-b8fcd2223358 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2f9e5c2b-747e-41b7-92e1-40dd1da829ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0696104
Jun 01 18:56:38.279845 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-e061e963-93a7-401b-9574-a119402acf6f service neutron] 10.222.0.25 "GET /v2.0/networks/2f9e5c2b-747e-41b7-92e1-40dd1da829ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2789235
Jun 01 18:56:38.340164 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97214763-efef-4b74-879a-3a8277358a45 req-c99fd1e6-e50c-4b8b-b614-96a19f15bc29 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:38.341675 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97214763-efef-4b74-879a-3a8277358a45 req-c99fd1e6-e50c-4b8b-b614-96a19f15bc29 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 948 time: 0.1547279
Jun 01 18:56:38.392117 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-bf5a91c7-b986-4c78-a5c9-dba2a65ae05f tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:38.393575 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-bf5a91c7-b986-4c78-a5c9-dba2a65ae05f tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 814 time: 0.2343535
Jun 01 18:56:38.408893 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-0529e0c4-d032-49b2-88e4-bf10da6a77cf tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/quotas/6606e2f3c3034216a3ea2e1102480063 HTTP/1.1" status: 200  len: 375 time: 0.0096338
Jun 01 18:56:38.454947 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-6d014c8a-d857-46c4-9b15-6773c6b6947d tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0408089
Jun 01 18:56:38.456202 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-97214763-efef-4b74-879a-3a8277358a45 req-3c3e498f-552c-473e-8a89-e324e1751a48 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625925
Jun 01 18:56:38.461302 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3f58301d-46e1-4d62-8469-1deef89fc875 req-d91556f9-449f-441e-9c12-ec817fb2df31 service neutron] 10.222.0.25 "GET /v2.0/networks/2f9e5c2b-747e-41b7-92e1-40dd1da829ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1744006
Jun 01 18:56:38.584554 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-0cbc59b1-8bec-4404-9f1d-b3061e4423e9 service neutron] 10.222.0.22 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1222410
Jun 01 18:56:38.713289 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-cf6ce22b-91ae-4b4b-b902-ef1bc2dede3c service neutron] 10.222.0.22 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1231399
Jun 01 18:56:38.883133 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ee6863f0-0444-43cc-b9a6-1be035ea4d0c req-395b7956-cd3d-4c36-ba1f-ed9a63b95520 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 210 time: 0.0423539
Jun 01 18:56:39.642509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c57d8-d224-4fce-81a9-260f2c78970e req-80e11e9f-3fd9-43e8-af3f-ef3c7c81c106 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:39.643950 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-251c57d8-d224-4fce-81a9-260f2c78970e req-80e11e9f-3fd9-43e8-af3f-ef3c7c81c106 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 948 time: 0.0836818
Jun 01 18:56:39.687783 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-251c57d8-d224-4fce-81a9-260f2c78970e req-dc1a45c2-251a-4a7c-a5d9-484fb508e1bb tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383377
Jun 01 18:56:39.973806 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-ba52fbae-0994-4bc2-923f-f2e4e0fe2950 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:39.975257 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-ba52fbae-0994-4bc2-923f-f2e4e0fe2950 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 814 time: 0.1503165
Jun 01 18:56:40.023260 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Request body: {'port': {'device_id': '5501e56d-92de-4766-a2e1-e396360a20d8', 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb', 'admin_state_up': True, 'tenant_id': '6606e2f3c3034216a3ea2e1102480063'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:56:40.056650 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-560c9307-5766-4552-98c3-6ba2b425ae0c req-ba6b62bf-e757-4cbd-967b-06c43c3e96c3 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 210 time: 0.0693066
Jun 01 18:56:40.166250 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:56:40.176211 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:56:40.185490 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Made reservation on behalf of 6606e2f3c3034216a3ea2e1102480063 for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:56:40.189036 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.348771 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Allocated IP 172.20.0.10 (0cddf53f-fbeb-4e8a-86ec-9167067ec0cb/a05ac98a-6bf9-4f53-908b-71fcdd651ada/3f8738a8-e0e8-4a12-8e9a-252bd260c3b3) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:56:40.552180 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.580675 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.585842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-92286660-784e-4fc9-8f78-0bf1570d2df5 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:40.652786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:56:40.655784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:56:40.660110 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:56:40.689442 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Pushing event updated for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:40.695425 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:40.726633 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:40.727241 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.752476 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.7633171
Jun 01 18:56:40.769367 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Request body: {'port': {'device_id': '5501e56d-92de-4766-a2e1-e396360a20d8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:56:40.850245 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.876139 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905e990b-cbce-4f3c-a07c-feb9b95c9939 req-52a68e0e-d961-4783-b3cf-637981b1f3fa tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:40.877607 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-905e990b-cbce-4f3c-a07c-feb9b95c9939 req-52a68e0e-d961-4783-b3cf-637981b1f3fa tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 948 time: 0.0802252
Jun 01 18:56:40.881930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:40.921317 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-905e990b-cbce-4f3c-a07c-feb9b95c9939 req-b21f1906-d708-4fc6-b538-d16bece02eff tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377707
Jun 01 18:56:41.087930 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:56:41.226204 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:41.239736 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae', 'network_id': '2f9e5c2b-747e-41b7-92e1-40dd1da829ed', 'port_id': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae', 'mac_address': 'fa:16:3e:2f:08:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 77, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '651f7706-feb5-49b8-bd41-f9b424b82cd6', 'ip_address': '192.168.233.139'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:56:41.293800 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.310743 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:56:41.326869 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:41.331073 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.332957 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:41.384810 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5bce81-8780-442e-a25c-4beea688ee22 req-390db8f0-8e01-42d5-ab73-eb7e05f6d3b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:41.385509 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-7c5bce81-8780-442e-a25c-4beea688ee22 req-390db8f0-8e01-42d5-ab73-eb7e05f6d3b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Synchronizing usage tracker for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:56:41.400121 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:41.406949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:56:41.407342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.407692 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.408065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.408552 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.408887 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.409217 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.409540 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.409862 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.410186 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.410508 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.410828 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.411147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:56:41.415286 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:41.416669 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.420929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-7c5bce81-8780-442e-a25c-4beea688ee22 req-390db8f0-8e01-42d5-ab73-eb7e05f6d3b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Unset dirty status for tenant:6606e2f3c3034216a3ea2e1102480063 on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:56:41.422093 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7c5bce81-8780-442e-a25c-4beea688ee22 req-390db8f0-8e01-42d5-ab73-eb7e05f6d3b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 932 time: 0.2020421
Jun 01 18:56:41.447992 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Transition to ACTIVE for port object 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:56:41.454928 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.460300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ef52413a-4b3f-473e-978f-082385aa529f tempest-AttachVolumeShelveTestJSON-2036049006 tempest-AttachVolumeShelveTestJSON-2036049006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:41.574289 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7c5bce81-8780-442e-a25c-4beea688ee22 req-e0772e6f-34fd-4ef1-9606-012ccf8a5727 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1455777
Jun 01 18:56:41.600500 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:56:41.662052 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Pushing event updated for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:41.667275 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:41.706403 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Attempting to bind port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:56:41.706743 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Attempting to bind port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:56:41.707069 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Attempting to bind port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:56:41.712065 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:56:41.712213 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Attempting to bind port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 on network 0cddf53f-fbeb-4e8a-86ec-9167067ec0cb {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:56:41.717276 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 56, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:56:41.717600 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Checking segment: {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:56:41.717978 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Bound using segment: {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:56:41.718404 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Bound port: 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1856cdc6-6697-441f-a6f2-d3fc325137dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 75, 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:56:41.718747 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.807349 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:56:41.810299 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:56:41.814793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.819142 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-11f72753-f0ae-471c-8eb4-b0377dfc3c83 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:41.877788 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:41.878401 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:41.879740 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] 10.222.0.25 "PUT /v2.0/ports/3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 HTTP/1.1" status: 200  len: 1094 time: 1.1153355
Jun 01 18:56:41.880230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:41.882521 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b49f0417-9683-43ce-bbd9-8fe51907c75d" -d '{"events": [{"name": "network-changed", "server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:41.900955 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Pushing event updated for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:41.904259 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f10a247c-44f0-4eca-8aa9-3872b5f6093d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:41.997581 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-2cc4c554-3d09-4d3e-8125-5f8ee2762242 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:41.999090 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-2cc4c554-3d09-4d3e-8125-5f8ee2762242 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 1097 time: 0.0758057
Jun 01 18:56:42.101139 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a7ae7ad-d885-4b19-bb7d-7cf649c4e47b x-openstack-request-id: req-0a7ae7ad-d885-4b19-bb7d-7cf649c4e47b {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:42.101467 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:42.101759 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-0a7ae7ad-d885-4b19-bb7d-7cf649c4e47b {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:42.102181 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3', 'status': 'completed', 'code': 200}
Jun 01 18:56:42.113786 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-e80273e5-5b30-4de7-801b-0fe6d849b5a9 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 HTTP/1.1" status: 200  len: 217 time: 0.1066325
Jun 01 18:56:42.195222 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-501a67f1-19fc-49ee-a125-9589e7084270 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:42.196641 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-501a67f1-19fc-49ee-a125-9589e7084270 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 200  len: 854 time: 0.0758963
Jun 01 18:56:42.205002 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129a6bae-d5a4-41f2-a52a-6b6e8fd06b44 req-59b928e9-3a46-4e54-b972-f903323a8895 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:42.206318 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-129a6bae-d5a4-41f2-a52a-6b6e8fd06b44 req-59b928e9-3a46-4e54-b972-f903323a8895 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 949 time: 0.1468925
Jun 01 18:56:42.260393 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-4ba3e2e4-8d2f-4733-9b67-eb3261b1dcc4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0531864
Jun 01 18:56:42.307284 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-129a6bae-d5a4-41f2-a52a-6b6e8fd06b44 req-1be5dc19-41d0-4609-9834-3a336455df37 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0701735
Jun 01 18:56:42.405742 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-5fcf1d5e-cfc2-4ccc-ba6d-de4497e42333 service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1305709
Jun 01 18:56:42.534623 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5ad9f383-3049-4be4-a58a-6792adf78e1a req-f8fc5bee-a91d-4389-a867-f133c7fd2b69 service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1197672
Jun 01 18:56:42.663389 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-ffb31f1b-c7e1-4668-9d22-1b7cb329cadc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:42.664802 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-ffb31f1b-c7e1-4668-9d22-1b7cb329cadc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6606e2f3c3034216a3ea2e1102480063&device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 1097 time: 0.0733774
Jun 01 18:56:42.762328 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4514d2fe-9487-41d5-af72-f4b3e4f5c104 req-2fd6a2a8-6d12-4fbe-9647-8d42a39ee291 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:42.763792 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4514d2fe-9487-41d5-af72-f4b3e4f5c104 req-2fd6a2a8-6d12-4fbe-9647-8d42a39ee291 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 944 time: 0.0841870
Jun 01 18:56:42.801196 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-06694501-7523-4f75-80da-ffd1f8dd77fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:42.802631 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-06694501-7523-4f75-80da-ffd1f8dd77fb service neutron] 10.222.0.25 "GET /v2.0/networks?id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 200  len: 914 time: 0.1311913
Jun 01 18:56:42.809594 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4514d2fe-9487-41d5-af72-f4b3e4f5c104 req-d38e5d65-2925-4bcc-bb66-974658b4317e tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388832
Jun 01 18:56:42.869870 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-7544615f-f3b1-4360-a7db-950625f6749c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 HTTP/1.1" status: 200  len: 217 time: 0.0597589
Jun 01 18:56:43.024370 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-88df0e2e-ac6e-48f0-8470-7ce0344f29a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:43.025969 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-88df0e2e-ac6e-48f0-8470-7ce0344f29a4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 200  len: 854 time: 0.1490705
Jun 01 18:56:43.072845 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-2f34d953-0177-410b-aed3-adf003c3fd7e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0395193
Jun 01 18:56:43.106126 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:56:43.173243 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:56:43.177645 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:56:43.178023 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:43.205847 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-b5ea2fce-d50d-4813-9898-e08d4997ff4a service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1257389
Jun 01 18:56:43.293468 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:43.322864 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:43.325148 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13e8ba24-1586-40c9-84d2-1ab5c52e50e5" -d '{"events": [{"server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "name": "network-vif-plugged", "status": "completed", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:43.333677 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:43.339697 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:43.342242 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:43.344089 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b49f0417-9683-43ce-bbd9-8fe51907c75d req-cd874c95-c3dd-4482-9abc-028f77d40c5c service neutron] 10.222.0.25 "GET /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1309977
Jun 01 18:56:43.384756 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a5482d7-11ef-487c-a5e5-8cce25f81674 x-openstack-request-id: req-8a5482d7-11ef-487c-a5e5-8cce25f81674 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:43.385065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "name": "network-vif-plugged", "status": "completed", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:43.385298 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-8a5482d7-11ef-487c-a5e5-8cce25f81674 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:43.385682 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae', 'code': 200}
Jun 01 18:56:43.426511 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:43.429856 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:43.504865 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1decf9-5388-438f-abd2-aed48408e7a7 req-fabb45ae-a09f-4894-a35f-d3b02dccf88e tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:43.506346 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca1decf9-5388-438f-abd2-aed48408e7a7 req-fabb45ae-a09f-4894-a35f-d3b02dccf88e tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 950 time: 0.0852261
Jun 01 18:56:43.559803 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-ca1decf9-5388-438f-abd2-aed48408e7a7 req-bace56de-b565-49a8-8614-28a27295f878 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437691
Jun 01 18:56:43.612098 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae9b8213-a4ad-44d2-8c90-0e83cf0d917a req-e3b73937-cc55-4a7a-9a7a-6c3091586193 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:43.613583 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae9b8213-a4ad-44d2-8c90-0e83cf0d917a req-e3b73937-cc55-4a7a-9a7a-6c3091586193 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 1103 time: 0.0733056
Jun 01 18:56:43.655810 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ae9b8213-a4ad-44d2-8c90-0e83cf0d917a req-ccc79881-9a97-4b67-9cee-081be8b381b2 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0333817
Jun 01 18:56:43.992806 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf23d48-a2aa-4224-beaa-d6c2e55e7779 req-6e20204a-4618-49ff-b245-d95e0fa446b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:43.994255 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dcf23d48-a2aa-4224-beaa-d6c2e55e7779 req-6e20204a-4618-49ff-b245-d95e0fa446b4 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 944 time: 0.0788610
Jun 01 18:56:44.037629 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-dcf23d48-a2aa-4224-beaa-d6c2e55e7779 req-f52c9f20-1a35-42e0-a35f-dc08a18e7aa1 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378401
Jun 01 18:56:44.148211 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1cce14d8-8c60-4886-969b-ff70e22fd4d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:44.750602 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205671d2-fdc7-429c-941a-5b7b5be7c453 req-a82aeb59-be49-4b2a-a77f-846eefa8d6e4 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:44.752028 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-205671d2-fdc7-429c-941a-5b7b5be7c453 req-a82aeb59-be49-4b2a-a77f-846eefa8d6e4 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 950 time: 0.0798302
Jun 01 18:56:44.795604 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-205671d2-fdc7-429c-941a-5b7b5be7c453 req-dc90662e-dd1e-41bc-980e-c9367871235d tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378973
Jun 01 18:56:45.126213 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:56:45.226224 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5daeb37f-36b6-43eb-8ca8-a5012b6b9550 req-48e4a945-0866-44ba-974a-79bbb9f11568 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:45.227684 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5daeb37f-36b6-43eb-8ca8-a5012b6b9550 req-48e4a945-0866-44ba-974a-79bbb9f11568 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 944 time: 0.0850282
Jun 01 18:56:45.235257 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f223c509-ea19-416f-8237-12e295d09111 req-842c674e-4ad2-49bb-99cb-6c1af27034ce tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:45.236769 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f223c509-ea19-416f-8237-12e295d09111 req-842c674e-4ad2-49bb-99cb-6c1af27034ce tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 950 time: 0.0955796
Jun 01 18:56:45.260717 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:45.274476 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3', 'network_id': '0cddf53f-fbeb-4e8a-86ec-9167067ec0cb', 'port_id': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3', 'mac_address': 'fa:16:3e:32:10:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 75, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a05ac98a-6bf9-4f53-908b-71fcdd651ada', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:56:45.281353 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-f223c509-ea19-416f-8237-12e295d09111 req-01581251-d76d-4fae-9996-bff7259a241a tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391524
Jun 01 18:56:45.288155 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5daeb37f-36b6-43eb-8ca8-a5012b6b9550 req-86493281-9428-4a66-a161-47aa31b8f6a3 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0536168
Jun 01 18:56:45.337004 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:45.353780 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:56:45.369096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:45.373093 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:45.374814 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:45.437923 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:45.440774 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:45.617585 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['3f8738a8-e0e8-4a12-8e9a-252bd260c3b3'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:56:46.468498 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b98cb0-eefc-4a69-9840-9b34f5eaf15f req-04bc471f-f067-4cf0-aac5-c8e864b2b83e tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:46.469999 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-34b98cb0-eefc-4a69-9840-9b34f5eaf15f req-04bc471f-f067-4cf0-aac5-c8e864b2b83e tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 950 time: 0.0826721
Jun 01 18:56:46.490560 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78abe51-506d-4b60-9dcf-625bf041493d req-ad8a2a9d-a71f-4228-a0c9-87233d5e3842 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:46.492129 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d78abe51-506d-4b60-9dcf-625bf041493d req-ad8a2a9d-a71f-4228-a0c9-87233d5e3842 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 945 time: 0.0931592
Jun 01 18:56:46.515789 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-34b98cb0-eefc-4a69-9840-9b34f5eaf15f req-3018c72e-f77a-4b89-a713-d287aa606062 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/security-groups?id=2b987c58-bebc-4928-a5f4-899687301e54&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399251
Jun 01 18:56:46.536874 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-d78abe51-506d-4b60-9dcf-625bf041493d req-d4399594-14eb-4533-9fcd-4a13f429aea8 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388680
Jun 01 18:56:46.633765 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-eb966377-4d09-494e-bb81-face1f701892 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:46.635163 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-eb966377-4d09-494e-bb81-face1f701892 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 950 time: 0.0781729
Jun 01 18:56:46.736708 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e17a9f4b-65b8-4583-aa42-964bc2db12b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:46.773060 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Deleting port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:56:46.773410 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:46.874641 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:46.905784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] For port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,segment=NetworkSegment(cca38853-2470-455c-b471-569f58a7b8fe),segment_id=cca38853-2470-455c-b471-569f58a7b8fe)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:46.906142 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.027861 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Calling delete_port for 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:56:47.137199 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.137884 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:56:47.143193 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:47.168512 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:56:47.186451 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Pushing event deleted for resources: {'Port': ['ID=0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:47.188862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:47.245598 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:56:47.250941 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:56:47.251307 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.276236 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] No DVR routers for this DVR port 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:56:47.278824 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.283502 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'name': 'network-vif-deleted', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:47.285819 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48157e6f-5696-474a-8436-374e4a6add29" -d '{"events": [{"server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "name": "network-vif-deleted", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:47.305443 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-7895125a-d92a-4fa8-a2a3-8c2d69ff3e51 req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.25 "DELETE /v2.0/ports/0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae HTTP/1.1" status: 204  len: 173 time: 0.6635714
Jun 01 18:56:47.348957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc99fa55-d740-4b49-a160-3bdae5d7be7a x-openstack-request-id: req-cc99fa55-d740-4b49-a160-3bdae5d7be7a {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:47.349373 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3", "name": "network-vif-deleted", "tag": "0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:47.349670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-cc99fa55-d740-4b49-a160-3bdae5d7be7a {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:47.350293 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3', 'name': 'network-vif-deleted', 'tag': '0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae', 'status': 'completed', 'code': 200}
Jun 01 18:56:47.385287 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.414353 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:56:47.416740 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96e8c8a4-c8fa-45d2-8b19-f7de199a6bc1" -d '{"events": [{"server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "name": "network-vif-plugged", "status": "completed", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:56:47.424878 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:56:47.428363 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.430174 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:47.464372 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:56:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d8ffd8a-bb36-4781-8157-39882f3f8116 x-openstack-request-id: req-7d8ffd8a-bb36-4781-8157-39882f3f8116 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:56:47.464691 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "name": "network-vif-plugged", "status": "completed", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:56:47.464945 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7d8ffd8a-bb36-4781-8157-39882f3f8116 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:56:47.465330 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3', 'code': 200}
Jun 01 18:56:47.498198 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:47.501516 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:47.683455 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-49178e53-5016-4237-98da-757ca6441828 req-1206dff5-84f3-40ec-b83a-b9d5d512afc7 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] 10.222.0.22 "GET /v2.0/ports?device_id=ff2a4e54-f43f-4474-bfe7-a129cf4bcdd3 HTTP/1.1" status: 200  len: 210 time: 0.0471332
Jun 01 18:56:47.832699 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:47.857689 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-811f9e7c-3d31-43a3-b3fe-366a96fd11e7 req-6ca3674f-22fb-4f6e-b909-13e75842e3a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:47.859164 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-811f9e7c-3d31-43a3-b3fe-366a96fd11e7 req-6ca3674f-22fb-4f6e-b909-13e75842e3a6 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 1099 time: 0.2376187
Jun 01 18:56:47.870513 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24484e66-caab-4c15-8963-af33aa77b2ce req-9a42a846-f5a8-4ee7-9a08-df161a642a15 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:47.871832 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-24484e66-caab-4c15-8963-af33aa77b2ce req-9a42a846-f5a8-4ee7-9a08-df161a642a15 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 946 time: 0.2145870
Jun 01 18:56:47.941305 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-811f9e7c-3d31-43a3-b3fe-366a96fd11e7 req-e2de54b0-e37f-4800-a71b-29b0e6bacadc service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684102
Jun 01 18:56:47.946407 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-24484e66-caab-4c15-8963-af33aa77b2ce req-b2f04170-c7b7-4d2e-a48e-72c676d6a058 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0613365
Jun 01 18:56:49.128814 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40994786-21ac-499c-8727-2d11463100d6 req-db46d9fa-de23-4690-b509-8093a4ae6d8e tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:56:49.130265 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-40994786-21ac-499c-8727-2d11463100d6 req-db46d9fa-de23-4690-b509-8093a4ae6d8e tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 946 time: 0.0804563
Jun 01 18:56:49.178557 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-40994786-21ac-499c-8727-2d11463100d6 req-9bde4930-7b8b-4867-adfd-1bf59902971c tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425415
Jun 01 18:56:49.545815 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:51.188758 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:56:51.220286 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:56:51.256728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:56:51.257096 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 0929fbc8-ad67-49a3-b39c-ac6e0c57b5ae not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:56:53.240084 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42358) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:53.385468 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-a445a965-3d61-4b43-818b-29eaf5b9ebd5 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=4118ca0d60b9458c82ba995083573caf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1440594
Jun 01 18:56:53.387862 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42362) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:56:53.444773 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:53.469379 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:53.520987 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:53.525814 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-bb47ba29-edbe-4294-9d29-074d698f4d7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:56:53.538416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b987c58-bebc-4928-a5f4-899687301e54,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:56:53.541158 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:56:53.549423 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:56:53.550531 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-83ed5bfe-dac1-4575-b110-e455f080385f admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/2b987c58-bebc-4928-a5f4-899687301e54 HTTP/1.1" status: 204  len: 168 time: 0.1617930
Jun 01 18:57:10.400438 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce545e86-c39f-40b6-97a6-174a0ab5ffb8 req-3265b746-b2a7-43b7-b75e-46eb8bf8a7ca tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:10.401908 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ce545e86-c39f-40b6-97a6-174a0ab5ffb8 req-3265b746-b2a7-43b7-b75e-46eb8bf8a7ca tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 946 time: 0.0852239
Jun 01 18:57:10.446027 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ce545e86-c39f-40b6-97a6-174a0ab5ffb8 req-ca6f376f-fb84-436f-8f47-fb86f9492bc9 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385034
Jun 01 18:57:10.862888 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:11.632685 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9d34a89-8e27-46fa-a18f-719111e33115 req-b9aeb667-fdc6-467e-8833-e57adfc2a5d0 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:11.634502 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9d34a89-8e27-46fa-a18f-719111e33115 req-b9aeb667-fdc6-467e-8833-e57adfc2a5d0 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 946 time: 0.0799773
Jun 01 18:57:11.680058 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-a9d34a89-8e27-46fa-a18f-719111e33115 req-4de0bb17-b5b2-4cc8-b96b-00aff32ab826 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/security-groups?id=ac5c48af-8e37-4bce-864e-17101cdd6bb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397725
Jun 01 18:57:12.035836 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-5cf41b92-5e62-463b-b1af-cbe20d51c151 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:12.037276 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-5cf41b92-5e62-463b-b1af-cbe20d51c151 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 946 time: 0.0799246
Jun 01 18:57:12.175321 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Deleting port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:57:12.175658 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:12.303465 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] For port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,segment=NetworkSegment(1856cdc6-6697-441f-a6f2-d3fc325137dc),segment_id=1856cdc6-6697-441f-a6f2-d3fc325137dc)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:57:12.303821 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:12.423362 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Calling delete_port for 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:57:12.534167 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:12.539709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d6118d44-a514-48c5-abe7-9dbb13e2154d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:12.549297 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['3f8738a8-e0e8-4a12-8e9a-252bd260c3b3'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:57:12.585218 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Pushing event deleted for resources: {'Port': ['ID=3f8738a8-e0e8-4a12-8e9a-252bd260c3b3,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:12.613970 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:12.658753 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] No DVR routers for this DVR port 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:57:12.661141 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:12.663540 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'name': 'network-vif-deleted', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:57:12.665800 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-592943cf-74b4-422c-9987-760ee9936142" -d '{"events": [{"server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "name": "network-vif-deleted", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:57:12.680187 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-2d64438c-3807-4e01-9722-4dd22651bd84 req-8d6053a1-d38c-4edc-9399-0cd263aa7cc5 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.25 "DELETE /v2.0/ports/3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 HTTP/1.1" status: 204  len: 173 time: 0.6344590
Jun 01 18:57:12.712813 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:57:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a043832d-ad28-4888-8b84-4f530bd6e888 x-openstack-request-id: req-a043832d-ad28-4888-8b84-4f530bd6e888 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:57:12.713370 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5501e56d-92de-4766-a2e1-e396360a20d8", "name": "network-vif-deleted", "tag": "3f8738a8-e0e8-4a12-8e9a-252bd260c3b3", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:57:12.713723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-a043832d-ad28-4888-8b84-4f530bd6e888 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:57:12.714383 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5501e56d-92de-4766-a2e1-e396360a20d8', 'name': 'network-vif-deleted', 'tag': '3f8738a8-e0e8-4a12-8e9a-252bd260c3b3', 'status': 'completed', 'code': 200}
Jun 01 18:57:12.842512 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-523d1c01-d416-4789-82f0-4ed90e29772d req-db620e1a-6b55-4e57-9488-83f98c5eb9d7 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] 10.222.0.22 "GET /v2.0/ports?device_id=5501e56d-92de-4766-a2e1-e396360a20d8 HTTP/1.1" status: 200  len: 210 time: 0.0510623
Jun 01 18:57:14.149396 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9c78c780-62a2-429b-bfa3-b23b6334b3cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:15.321996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:57:15.355225 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:57:15.355568 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 3f8738a8-e0e8-4a12-8e9a-252bd260c3b3 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:57:16.737522 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ca7e9951-9730-495c-a9ff-197f14074c22 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:16.878921 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:17.833764 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:19.546926 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:28.218069 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:57:40.881175 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:41.414842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42590) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:57:41.457077 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-0ad71df6-3674-485d-876f-e6511b2ec1b8 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2026453
Jun 01 18:57:41.480638 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Deleting subnet a05ac98a-6bf9-4f53-908b-71fcdd651ada {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 18:57:41.483664 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:41.536375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:41.645182 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:41.721807 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69775e4-d18c-4874-930f-88d25a30a488 req-a9bfab37-b439-4d41-ba45-80ebb81d9ce4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:41.723155 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-a9bfab37-b439-4d41-ba45-80ebb81d9ce4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1099 time: 0.1603878
Jun 01 18:57:42.095949 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69775e4-d18c-4874-930f-88d25a30a488 req-78a47882-5ccb-45af-9637-6863a6dabab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:42.097910 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-78a47882-5ccb-45af-9637-6863a6dabab0 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.3023670
Jun 01 18:57:42.194125 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.202500 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:42.238481 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a05ac98a-6bf9-4f53-908b-71fcdd651ada,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:42.242809 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.251184 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-ce4c6586-0439-4813-8713-c76138b83abd service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 1002 time: 0.1463535
Jun 01 18:57:42.256368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.256774 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.257148 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.257514 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.257876 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.258237 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.258601 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.258957 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.259311 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.259662 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.260018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.260715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.264073 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:42.265535 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-001f1ec3-d8d9-4061-aa14-e4585751e776 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/a05ac98a-6bf9-4f53-908b-71fcdd651ada HTTP/1.1" status: 204  len: 168 time: 0.8497727
Jun 01 18:57:42.268828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42596) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:57:42.323071 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69775e4-d18c-4874-930f-88d25a30a488 req-b4cf1c7b-adee-4cfb-88fd-ac91448e06a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:42.324541 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-b4cf1c7b-adee-4cfb-88fd-ac91448e06a3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0580294
Jun 01 18:57:42.369934 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.403556 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69775e4-d18c-4874-930f-88d25a30a488 req-b6174006-24e8-45e9-b4f5-fada88679f8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:42.405190 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-b6174006-24e8-45e9-b4f5-fada88679f8d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0729740
Jun 01 18:57:42.419642 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-5d606b1a-f678-49fb-b1f8-50ac5da42647 service neutron] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98258) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:57:42.420616 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-5d606b1a-f678-49fb-b1f8-50ac5da42647 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0049422
Jun 01 18:57:42.494828 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.507754 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3c7f84400>,) {'filters': {'network_id': ['0cddf53f-fbeb-4e8a-86ec-9167067ec0cb']}} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:57:42.520328 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7f84400>, '1856cdc6-6697-441f-a6f2-d3fc325137dc') {'for_net_delete': True} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:57:42.520645 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.services.segments.db [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3c7f84400>, '1856cdc6-6697-441f-a6f2-d3fc325137dc') {} {{(pid=98259) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:57:42.531824 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2552187'] for segment, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.547621 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.552917 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-ca3c438f-f095-4c83-909b-3004debd3600 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1243451
Jun 01 18:57:42.554293 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Releasing vlan 75 on physical network physnet1 to pool {{(pid=98259) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 18:57:42.554697 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2208267'] for segment, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]: Traceback (most recent call last):
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     timer()
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     cb(*args, **kw)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     return func(*args, **kwargs)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     self._notify()
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     self.callback(batched_events)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     event.method(event)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     return f(self, *a, **k)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._get(url).json()
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     return self.request(url, 'GET', **kwargs)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 18:57:42.571381 dv-cinder-794021-1-iscsi neutron-server[98259]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 18:57:42.647651 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.652703 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:42.656079 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:42.687390 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-b69775e4-d18c-4874-930f-88d25a30a488 req-403bb3ae-e048-4ecd-8a9d-44fbf2a6dd49 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1271801
Jun 01 18:57:42.771665 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Pushing event deleted for resources: {'Network': ['ID=0cddf53f-fbeb-4e8a-86ec-9167067ec0cb,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:42.781514 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.781884 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.782250 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.782607 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.783007 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.783363 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.783737 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.784090 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.784465 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.784820 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.785167 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.785513 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:42.788637 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:42.790418 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-1e184205-2afd-4ac1-a390-76dbcd955ac9 admin admin] 10.222.0.22 "DELETE /v2.0/networks/0cddf53f-fbeb-4e8a-86ec-9167067ec0cb HTTP/1.1" status: 204  len: 168 time: 0.5204430
Jun 01 18:57:42.972142 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42602) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:57:43.018587 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-35a296c8-c31d-4d74-8d33-27c91d47926e admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=6606e2f3c3034216a3ea2e1102480063&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0452440
Jun 01 18:57:43.020917 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42604) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:57:43.077653 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:43.102506 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:43.153112 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:43.156649 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-eadb014a-ab5f-4d10-8f97-540b065c8b45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:43.170343 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac5c48af-8e37-4bce-864e-17101cdd6bb3,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:43.172908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:43.181310 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:43.182477 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/ac5c48af-8e37-4bce-864e-17101cdd6bb3 HTTP/1.1" status: 204  len: 168 time: 0.1606071
Jun 01 18:57:44.149808 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c52e08e9-39c4-4dc8-8ede-6066770bbad5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:45.599006 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-2ea85288-d627-40ae-a4ea-677abfdccc0a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2096723707&fields=id&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 267 time: 0.0408480
Jun 01 18:57:45.755316 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-bb46bd04-b858-42e8-b88a-20e72a643351 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:45.756760 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-bb46bd04-b858-42e8-b88a-20e72a643351 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.1510606
Jun 01 18:57:45.771219 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-12c80816-73b1-43dd-b43e-651128f5b716 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/quotas/52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 375 time: 0.0089991
Jun 01 18:57:45.862608 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-60cfbfd8-481e-4d06-b0b1-a973bd89df76 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0855095
Jun 01 18:57:45.877313 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-8a6e6e66-9965-4403-a2fb-6ac1f8414acc service neutron] http://10.222.0.22:9696/v2.0/extensions returned with HTTP 200 {{(pid=98259) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 18:57:45.878804 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-8a6e6e66-9965-4403-a2fb-6ac1f8414acc service neutron] 10.222.0.22 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0055535
Jun 01 18:57:46.008778 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ebd9e5f3-c4a2-4287-89b4-4ec5fa656dc1 service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1247962
Jun 01 18:57:46.135653 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-22a8abf4-b3ae-49d8-8f1c-10406c325ec6 service neutron] 10.222.0.22 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1210723
Jun 01 18:57:46.626431 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0b6daeb7-d316-4c42-88ea-30c3cb7c3a27 req-089f83ed-3bdc-4804-a420-fcb05d598b33 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 210 time: 0.1535213
Jun 01 18:57:46.746557 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-e2cf0888-4394-4c5a-8711-84a04d94dbb3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:46.880332 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:47.740670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-d6113b5e-6cd5-40f2-ae70-bc2263f4c8a5 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:47.742431 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-d6113b5e-6cd5-40f2-ae70-bc2263f4c8a5 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 812 time: 0.1516719
Jun 01 18:57:47.781150 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c3379f67-e9c5-4a42-9576-845040bf7760 req-8f2ed728-7020-43fa-a25a-a7f9941dff5f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 210 time: 0.0424936
Jun 01 18:57:47.803610 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-26cd3e2b-01f6-4b70-a5c7-b2f0755fae4f tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=52dbd90f0982402bb02a793614e0020d HTTP/1.1" status: 200  len: 380 time: 0.0418839
Jun 01 18:57:47.814773 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'port': {'device_id': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'admin_state_up': True, 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'security_groups': ['79b7f04f-c3ff-42d0-82b2-2e6dd86603f0']}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:57:47.838791 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:47.950021 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:57:47.959767 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.quota.driver [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=98258) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:57:47.968953 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Made reservation on behalf of 52dbd90f0982402bb02a793614e0020d for: {'port': 1} {{(pid=98258) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 18:57:47.973226 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.134168 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_common [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.20.0.8 (ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27/e07cf14f-41ea-4248-9d27-d63b4df58f40/5f068024-85aa-46f6-885b-6a3f3be3c00d) {{(pid=98258) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:57:48.326571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.342122 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Transition to ACTIVE for port object 5f068024-85aa-46f6-885b-6a3f3be3c00d will not be triggered until provisioned by entity DHCP. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:57:48.368038 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_create {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.374982 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-7a9a6270-c219-4bdf-8b94-cc91dafee3c6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:48.554837 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 is already hosted by enough agents. {{(pid=98258) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:57:48.557891 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.base_scheduler [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98258) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:57:48.562271 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98258) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:57:48.587113 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=1']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:48.592759 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:48.627186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:48.627845 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.653602 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-ca9f4f10-e72c-45db-b077-2f0d60f7cd52 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8423657
Jun 01 18:57:48.665857 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.v2.base [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Request body: {'port': {'device_id': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98258) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:57:48.770850 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5d64e495-4303-4368-8a09-7bbfc014594a None None] Provisioning for port 5f068024-85aa-46f6-885b-6a3f3be3c00d completed by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:57:48.776246 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-5d64e495-4303-4368-8a09-7bbfc014594a None None] Provisioning complete for port 5f068024-85aa-46f6-885b-6a3f3be3c00d triggered by entity DHCP. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:57:48.776677 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5d64e495-4303-4368-8a09-7bbfc014594a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.781309 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:48.832858 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-5d64e495-4303-4368-8a09-7bbfc014594a None None] Port 5f068024-85aa-46f6-885b-6a3f3be3c00d cannot update to ACTIVE because it is not bound. {{(pid=98260) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 18:57:49.099737 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0f4a5c0-9b9b-4af8-8396-45519e92c2ba req-1b4e5aad-a7fa-48e7-a3ad-f05e0aa2360a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:49.100452 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-c0f4a5c0-9b9b-4af8-8396-45519e92c2ba req-1b4e5aad-a7fa-48e7-a3ad-f05e0aa2360a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:57:49.123649 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-c0f4a5c0-9b9b-4af8-8396-45519e92c2ba req-1b4e5aad-a7fa-48e7-a3ad-f05e0aa2360a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:57:49.124795 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c0f4a5c0-9b9b-4af8-8396-45519e92c2ba req-1b4e5aad-a7fa-48e7-a3ad-f05e0aa2360a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 931 time: 0.2291007
Jun 01 18:57:49.225665 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-c0f4a5c0-9b9b-4af8-8396-45519e92c2ba req-8d071ca0-e9ff-4eed-a8b4-d88c199e84c8 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0901203
Jun 01 18:57:49.229300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f068024-85aa-46f6-885b-6a3f3be3c00d {{(pid=98258) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:57:49.236737 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks [] for port, precommit_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.250571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.provisioning_blocks [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Transition to ACTIVE for port object 5f068024-85aa-46f6-885b-6a3f3be3c00d will not be triggered until provisioned by entity L2. {{(pid=98258) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 18:57:49.254480 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.258072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0c7ed54a-94e8-4f6f-915f-4f8360c39ab2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:49.383551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Pushing event updated for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=2']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:49.387064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:49.489892 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Attempting to bind port 5f068024-85aa-46f6-885b-6a3f3be3c00d on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 18:57:49.490221 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Attempting to bind port 5f068024-85aa-46f6-885b-6a3f3be3c00d by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 18:57:49.490546 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Attempting to bind port 5f068024-85aa-46f6-885b-6a3f3be3c00d on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:57:49.495006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Port 5f068024-85aa-46f6-885b-6a3f3be3c00d on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 18:57:49.495319 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Attempting to bind port 5f068024-85aa-46f6-885b-6a3f3be3c00d on network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 18:57:49.500229 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Checking agent: {'id': '27cf02eb-8b0c-44a4-b12e-50ee797bf1a5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'started_at': datetime.datetime(2021, 6, 1, 18, 45, 39), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 18, 57, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 18:57:49.500597 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Checking segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98258) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 18:57:49.500975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Bound using segment: {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'} {{(pid=98258) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 18:57:49.501393 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.managers [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Bound port: 5f068024-85aa-46f6-885b-6a3f3be3c00d, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bac363e-177f-4762-a171-bdf73801a782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 81, 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27'}}] {{(pid=98258) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 18:57:49.501735 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.555112 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.590728 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, cleared binding levels {{(pid=98258) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 18:57:49.593784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 18:57:49.598027 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1393640'] for port, after_update {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.602329 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:49.653067 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:49.653669 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:49.655000 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] 10.222.0.25 "PUT /v2.0/ports/5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 1093 time: 0.9935257
Jun 01 18:57:49.655499 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:57:49.658095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0c18022a-6fbf-461d-af74-d3cb47572f73" -d '{"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:57:49.738328 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:57:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb482dfd-6bb5-47b1-90de-e6c3421d447a x-openstack-request-id: req-bb482dfd-6bb5-47b1-90de-e6c3421d447a {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:57:49.738596 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:57:49.738692 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-bb482dfd-6bb5-47b1-90de-e6c3421d447a {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:57:49.739129 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'status': 'completed', 'code': 200}
Jun 01 18:57:49.746623 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Pushing event updated for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=3']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:49.749888 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-dfeb2f0b-d15f-47cc-ba32-e3940e29759d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:49.784550 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-c86c57d5-8bbe-4fa1-87fd-216bcb6049f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:49.786023 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-c86c57d5-8bbe-4fa1-87fd-216bcb6049f3 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1096 time: 0.0871584
Jun 01 18:57:49.862599 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-01ee6564-27a5-4606-aa2f-cf0f208f98e2 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 217 time: 0.0644183
Jun 01 18:57:49.927198 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-5921d1a4-9b6d-4631-8d87-bd683f678193 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:49.928631 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-5921d1a4-9b6d-4631-8d87-bd683f678193 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0587380
Jun 01 18:57:50.008715 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-525e9712-767e-4299-a892-aa8fbe0a7b32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.010146 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-525e9712-767e-4299-a892-aa8fbe0a7b32 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0719609
Jun 01 18:57:50.144269 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-102db1ae-a162-48e5-aa4c-3e619f48bde0 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1231558
Jun 01 18:57:50.421461 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-feee8a40-c465-4fff-9a1e-5a5cae0177ad req-7c73787c-9693-4478-aba0-66d46a77ab2f service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2669356
Jun 01 18:57:50.458503 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aff721e-fc11-4193-b171-0c1d937c157e req-3f33ec45-8d0a-47a3-8588-1b286250e439 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.459935 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3aff721e-fc11-4193-b171-0c1d937c157e req-3f33ec45-8d0a-47a3-8588-1b286250e439 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0992846
Jun 01 18:57:50.545953 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-3aff721e-fc11-4193-b171-0c1d937c157e req-e3db8dc6-e3c5-43d2-9662-b0df8aba0453 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0802658
Jun 01 18:57:50.570551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-7164f76f-b47c-4cf8-a86d-608385e527d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.571966 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-7164f76f-b47c-4cf8-a86d-608385e527d1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1096 time: 0.0918856
Jun 01 18:57:50.700688 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-cf6c8e77-ae63-4735-909c-fe79f5a8d197 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.702012 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-cf6c8e77-ae63-4735-909c-fe79f5a8d197 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1231577
Jun 01 18:57:50.769437 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-7d0cf06d-a949-40fa-86f7-79a1a92703ba service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 217 time: 0.0588744
Jun 01 18:57:50.833628 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-f8a71d2b-0054-4b02-acff-a082dabf46fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.834993 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-f8a71d2b-0054-4b02-acff-a082dabf46fc service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0589099
Jun 01 18:57:50.909881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-1554b2f5-f155-48db-9424-d8651da5111d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:50.911272 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-1554b2f5-f155-48db-9424-d8651da5111d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0673952
Jun 01 18:57:51.039844 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-d28c6fd0-f4ad-4051-9420-ef5c950f363f service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1209178
Jun 01 18:57:51.170803 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-0c18022a-6fbf-461d-af74-d3cb47572f73 req-07e33991-28ae-420b-8d5d-975466dbaa85 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1237309
Jun 01 18:57:51.736193 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf90ac7-668e-4ac2-a1fa-c7e6268f1e49 req-c0b2a15e-4ea8-466b-b012-e0aebcad0a6d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:51.739055 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bf90ac7-668e-4ac2-a1fa-c7e6268f1e49 req-c0b2a15e-4ea8-466b-b012-e0aebcad0a6d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0875206
Jun 01 18:57:51.789867 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3bf90ac7-668e-4ac2-a1fa-c7e6268f1e49 req-76163aa8-b062-4b18-a491-dd061c5528b2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435948
Jun 01 18:57:52.975013 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968fecba-77b2-4ed7-ae7d-3fa9e281f9c0 req-5847bd75-fe36-4216-beef-54d787684920 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:52.976450 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-968fecba-77b2-4ed7-ae7d-3fa9e281f9c0 req-5847bd75-fe36-4216-beef-54d787684920 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0831659
Jun 01 18:57:53.019157 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-968fecba-77b2-4ed7-ae7d-3fa9e281f9c0 req-ebbcf6b5-5fa4-4ff4-93c4-1bde26cc967d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0370395
Jun 01 18:57:54.202117 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556df176-1695-4b36-90c6-61bcbcff16d4 req-9f079a21-e513-4808-b1c6-ff7a724e8e18 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:54.203539 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-556df176-1695-4b36-90c6-61bcbcff16d4 req-9f079a21-e513-4808-b1c6-ff7a724e8e18 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0792537
Jun 01 18:57:54.248359 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-556df176-1695-4b36-90c6-61bcbcff16d4 req-65cabc7d-72c7-48ed-9c00-8394077b9618 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392101
Jun 01 18:57:55.430822 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8543f6-537a-407e-9bcc-57c577a2a55d req-e81d4bf9-05e9-42b7-9025-f90fe5581811 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:55.432419 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f8543f6-537a-407e-9bcc-57c577a2a55d req-e81d4bf9-05e9-42b7-9025-f90fe5581811 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0791895
Jun 01 18:57:55.475107 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-5f8543f6-537a-407e-9bcc-57c577a2a55d req-1ebd9728-bcb8-498b-b194-357a0ba1ecdb tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0370774
Jun 01 18:57:56.710339 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fca31fc-b73e-4f49-b0d6-e05b1dcb0bd8 req-7c218859-6360-4cc2-932e-bb39bbfdfe5e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:56.711773 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0fca31fc-b73e-4f49-b0d6-e05b1dcb0bd8 req-7c218859-6360-4cc2-932e-bb39bbfdfe5e tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 943 time: 0.0841351
Jun 01 18:57:56.755245 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-0fca31fc-b73e-4f49-b0d6-e05b1dcb0bd8 req-ea2f5867-2e4d-41d0-8ec3-db3ea4b1b514 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378196
Jun 01 18:57:57.633450 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5f068024-85aa-46f6-885b-6a3f3be3c00d details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98260) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 18:57:57.765464 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:57:57.779231 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Returning: {'device': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'port_id': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'mac_address': 'fa:16:3e:d8:3b:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 81, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98260) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 18:57:57.833728 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:57.850537 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f068024-85aa-46f6-885b-6a3f3be3c00d {{(pid=98260) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 18:57:57.865662 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:57:57.870031 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:57.871692 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-92d86788-63bc-492c-8bfa-0483240248f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:57.938311 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=4']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:57.939944 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdaee24-dce4-430e-aff1-4e97bf01df06 req-26224f29-a777-4e2d-aade-4f30b3930879 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:57.941416 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9bdaee24-dce4-430e-aff1-4e97bf01df06 req-26224f29-a777-4e2d-aade-4f30b3930879 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 944 time: 0.0825067
Jun 01 18:57:57.945943 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.946298 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.946660 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.946996 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.947326 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.947652 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.947974 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.948296 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.948646 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.948963 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.949280 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.949596 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:57:57.953391 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:57:57.986090 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-9bdaee24-dce4-430e-aff1-4e97bf01df06 req-f313da5f-6198-4c1a-9ed7-9d0391f4ddf7 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385833
Jun 01 18:57:58.135988 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] get_ports_and_sgs() called for port_ids ['5f068024-85aa-46f6-885b-6a3f3be3c00d'] {{(pid=98260) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 18:57:59.165405 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1b80c0-88da-41f7-ab80-4c91235fe66a req-537ec2a7-a758-4929-8ead-6ec094648fec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:57:59.166810 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b1b80c0-88da-41f7-ab80-4c91235fe66a req-537ec2a7-a758-4929-8ead-6ec094648fec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 944 time: 0.0782351
Jun 01 18:57:59.209004 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-4b1b80c0-88da-41f7-ab80-4c91235fe66a req-5fab9df9-fd53-4558-b81c-1d0ee21aedba tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0362604
Jun 01 18:57:59.649403 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5f068024-85aa-46f6-885b-6a3f3be3c00d up at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 18:57:59.716338 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning for port 5f068024-85aa-46f6-885b-6a3f3be3c00d completed by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 18:57:59.720783 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.provisioning_blocks [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Provisioning complete for port 5f068024-85aa-46f6-885b-6a3f3be3c00d triggered by entity L2. {{(pid=98260) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 18:57:59.721162 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1012312'] for port, provisioning_complete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:59.836106 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:59.861624 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d'}] {{(pid=98260) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:57:59.863811 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a9ded9ba3ea309474c521a841eff0e81c649034d3c5edf9e4d2f4295d1b55071" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7bd4bdb-a4fc-4ef7-a5bd-96b0bc7de542" -d '{"events": [{"server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "name": "network-vif-plugged", "status": "completed", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d"}]}' {{(pid=98260) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:57:59.872291 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:57:59.876753 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116'] for port, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:57:59.878569 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:57:59.912704 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:57:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a0f1aca-6d20-4b38-8dfe-edab22857a22 x-openstack-request-id: req-7a0f1aca-6d20-4b38-8dfe-edab22857a22 {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:57:59.913002 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "name": "network-vif-plugged", "status": "completed", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d", "code": 200}]} {{(pid=98260) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:57:59.913258 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-7a0f1aca-6d20-4b38-8dfe-edab22857a22 {{(pid=98260) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:57:59.913650 dv-cinder-794021-1-iscsi neutron-server[98260]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'code': 200}
Jun 01 18:57:59.948241 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Pushing event updated for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=5']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:57:59.951052 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:58:00.216018 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0ae8e5-8aad-4faf-aa5d-f0a951c8cbe1 req-ae95571f-f97a-4a20-bf0a-58d9762d5650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:00.217470 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bc0ae8e5-8aad-4faf-aa5d-f0a951c8cbe1 req-ae95571f-f97a-4a20-bf0a-58d9762d5650 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1098 time: 0.0676658
Jun 01 18:58:00.265466 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-bc0ae8e5-8aad-4faf-aa5d-f0a951c8cbe1 req-b08911cb-6f38-4e11-9a9f-b28feeba5ab1 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0374422
Jun 01 18:58:00.396393 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085d4cd2-5363-4933-8b9d-fcdb6ca9c6df req-61748fa7-388b-4e68-a47a-e06a9bb25317 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:00.397868 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-085d4cd2-5363-4933-8b9d-fcdb6ca9c6df req-61748fa7-388b-4e68-a47a-e06a9bb25317 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.0829217
Jun 01 18:58:00.441820 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-085d4cd2-5363-4933-8b9d-fcdb6ca9c6df req-ea447906-4700-40a2-804d-1957d9165040 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381060
Jun 01 18:58:01.626703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52307eaa-0127-4f26-a1ea-8d9404a67290 req-f2fc2998-12b3-4e2d-9d18-977fa93622bb tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:01.628131 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-52307eaa-0127-4f26-a1ea-8d9404a67290 req-f2fc2998-12b3-4e2d-9d18-977fa93622bb tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.0808604
Jun 01 18:58:01.671414 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-52307eaa-0127-4f26-a1ea-8d9404a67290 req-fe226a0d-4c31-46ee-bbdc-f6dc87ea8bbc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0376620
Jun 01 18:58:01.858955 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61c7c6e-229c-4614-99b9-4389d6833265 req-dc3a5165-97c8-4b28-b118-aa3c1b26904a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:01.860404 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c61c7c6e-229c-4614-99b9-4389d6833265 req-dc3a5165-97c8-4b28-b118-aa3c1b26904a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.0819721
Jun 01 18:58:01.906889 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-c61c7c6e-229c-4614-99b9-4389d6833265 req-f69ba4c7-83a7-4953-a7dd-28fc6c524f5c tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408864
Jun 01 18:58:01.929825 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42676) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:58:01.996878 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a173baef-ff77-4d8b-8025-da7887df3705 tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:01.998328 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a173baef-ff77-4d8b-8025-da7887df3705 tempest-TestVolumeBootPattern-1708187789 tempest-TestVolumeBootPattern-1708187789-project-admin] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1093 time: 0.0675647
Jun 01 18:58:02.000980 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42678) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:58:02.005226 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.v2.base [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Request body: {'floatingip': {'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'port_id': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address': '172.20.0.8'}} {{(pid=98259) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 18:58:02.010895 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 18:58:02.014649 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Usage tracker for resource:floatingip and tenant:52dbd90f0982402bb02a793614e0020d is out of sync, need to count used quota {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 18:58:02.017447 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=98259) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 18:58:02.024368 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.quota.driver [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=98259) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 18:58:02.033940 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:02.166177 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:02.298276 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.db_base_plugin_common [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Allocated IP 172.27.0.229 (51c15cd0-3fb9-458f-96e0-aa926a3585bf/c252d780-bee9-4a2c-a569-c3a5207a21ad/9e043274-9119-4443-8fb0-3acb51b6cab9) {{(pid=98259) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 18:58:02.531160 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:02.560459 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792820220865', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:02.564708 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-7e641812-7601-473c-8dfa-c8fc98bfde41 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:58:02.624510 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Network 51c15cd0-3fb9-458f-96e0-aa926a3585bf is already hosted by enough agents. {{(pid=98259) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 18:58:02.627334 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.base_scheduler [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Resources bound (agent type, host, resource id):  {{(pid=98259) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 18:58:02.630928 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Received port after_create {{(pid=98259) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 18:58:02.664785 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=9e043274-9119-4443-8fb0-3acb51b6cab9,revision_number=1']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:58:02.670750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:58:03.044770 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:03.118666 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1034507'] for port, before_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:03.326049 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for port, precommit_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:03.330326 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792820752541', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792820220883', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792820218116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2208367'] for port, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:03.333988 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-4fe3f7b8-c304-43a6-8f4f-87a9ef9c651f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:58:03.435100 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event updated for resources: {'Port': ['ID=9e043274-9119-4443-8fb0-3acb51b6cab9,revision_number=2']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:58:03.442317 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:58:03.452106 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1617377'] for floatingip, after_update {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:03.628040 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 69fb9ade-9763-4e33-adeb-43b0d95b7bec associated. External IP: 172.27.0.229, port: 5f068024-85aa-46f6-885b-6a3f3be3c00d.
Jun 01 18:58:04.072205 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:58:04.246942 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:58:04.256147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:58:04.265600 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:58:04.266225 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf3f4f0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:57:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:58:04.271202 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:04.326854 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-28817336-35e0-4050-b7a1-a76d205b91ec tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.3247426
Jun 01 18:58:04.327376 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:58:04.329675 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e349671a-7cd3-46bc-8a67-8a1159b5ba85" -d '{"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:58:04.378153 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:58:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-921c7ae3-f3f9-44d3-a9b1-3aca32659475 x-openstack-request-id: req-921c7ae3-f3f9-44d3-a9b1-3aca32659475 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:58:04.378491 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:58:04.378786 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-921c7ae3-f3f9-44d3-a9b1-3aca32659475 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:58:04.379216 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'status': 'completed', 'code': 200}
Jun 01 18:58:04.441212 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:58:04.473609 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-f851bfb9-88cc-4b10-836b-3c4afd125bb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:04.475157 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-f851bfb9-88cc-4b10-836b-3c4afd125bb2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1098 time: 0.0754728
Jun 01 18:58:04.609755 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-e32e81e4-c726-4b77-a96e-4395f5500408 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:04.611124 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-e32e81e4-c726-4b77-a96e-4395f5500408 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1295986
Jun 01 18:58:04.713364 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-1b9074ae-6a71-4734-b90d-2ed9611199b8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 999 time: 0.0960262
Jun 01 18:58:04.818152 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf3f4f0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '69fb9ade-9763-4e33-adeb-43b0d95b7bec', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:d8:3b:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:58:02Z', 'updated_at': '2021-06-01T18:58:02Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}, {'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:58:04.822257 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:58:04.830812 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:58:04.831428 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf3f4f0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:57:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:58:04.874967 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-afdfb220-aee5-4dc4-a0d8-60bfcd688fcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:04.876356 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-afdfb220-aee5-4dc4-a0d8-60bfcd688fcb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.1567361
Jun 01 18:58:04.954271 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-25b3eb49-be9d-4887-b11e-224acd926314 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:04.955762 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-25b3eb49-be9d-4887-b11e-224acd926314 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0723155
Jun 01 18:58:05.007326 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:58:05.087852 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-8f4e682c-f11b-4d84-a7d8-b6c05470bcc2 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1253903
Jun 01 18:58:05.217860 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:58:05.218490 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e349671a-7cd3-46bc-8a67-8a1159b5ba85 req-70e5834f-8c21-4391-9491-e7ba2f778f0f service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241755
Jun 01 18:58:05.353508 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdf3f4f0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '69fb9ade-9763-4e33-adeb-43b0d95b7bec', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:d8:3b:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:58:02Z', 'updated_at': '2021-06-01T18:58:02Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}, {'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:58:05.357376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deeef1c4-30fb-41df-b8ec-e6bf319a484b None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '69fb9ade-9763-4e33-adeb-43b0d95b7bec', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:d8:3b:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:58:02Z', 'updated_at': '2021-06-01T18:58:02Z', 'revision_number': 0, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}, {'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:58:05.523773 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d03dc20-e0ed-4949-af3d-b3fd2adcedca None None] New status for floating IP 69fb9ade-9763-4e33-adeb-43b0d95b7bec: ACTIVE {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:58:10.879846 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:14.152065 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-1655f1f8-51c4-4c6f-9f09-717fc9134847 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:16.741088 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-136833ba-3079-4b81-a4b3-f49c7351cda7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:16.882625 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:17.838978 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:19.552189 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:40.895046 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:42.216118 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:58:42.342383 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-6b894f6a-1990-4da7-bd42-db4a0a3eb91e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0682213
Jun 01 18:58:42.484633 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-b614eeaf-5f08-4da2-aa08-4b8984576c19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:42.485981 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-b614eeaf-5f08-4da2-aa08-4b8984576c19 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1099 time: 0.0741930
Jun 01 18:58:42.632191 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-37bac990-2ba2-468e-876c-f72cd8f96729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:42.633629 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-37bac990-2ba2-468e-876c-f72cd8f96729 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1237917
Jun 01 18:58:42.737157 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-fa550462-6d08-4d16-a1ef-a93c1fe9b05d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 1002 time: 0.0937548
Jun 01 18:58:42.801893 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-7d86ae2d-0694-4d4c-a50b-7764e62403d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:42.803286 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-7d86ae2d-0694-4d4c-a50b-7764e62403d9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0560858
Jun 01 18:58:42.880711 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-668fa453-7407-401a-a18e-9bd10d1d8da8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:58:42.882166 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-668fa453-7407-401a-a18e-9bd10d1d8da8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0689139
Jun 01 18:58:43.012323 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-8a708b2d-0bd0-4dfe-9442-6f8c23c6f236 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1204245
Jun 01 18:58:43.139770 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-ef4cd710-c513-4c40-86d1-fb31eecf0930 req-a4342417-0d4d-48b4-884c-67108e57e278 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1210878
Jun 01 18:58:44.154205 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-77dc31c6-9dd8-47e1-873e-59b42620f361 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:46.742605 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f94c584b-645a-48ee-a259-812c00ca9078 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:46.884440 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:47.842009 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:58:49.555501 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:10.893410 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:14.158656 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-71f45565-2420-40c1-9483-fce83a302588 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:16.744095 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-c446c183-ba3e-43d7-b572-d5b35a890d24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:16.885636 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:17.844376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:19.214608 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:59:19.558213 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:40.893223 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:43.548783 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42706) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:59:43.807886 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port 9e043274-9119-4443-8fb0-3acb51b6cab9 {{(pid=98259) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:59:43.808166 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:43.922574 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:43.922894 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:44.046471 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.plugins.ml2.plugin [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for 9e043274-9119-4443-8fb0-3acb51b6cab9 owned by network:floatingip {{(pid=98259) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:59:44.160492 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-878dda9e-6ae5-4d01-8f94-7f3c15e4d659 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:44.175661 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2208374'] for port, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:44.179883 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-6a3027b6-1bbe-46d6-b1b7-bbe1e770ccbc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:44.222086 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=9e043274-9119-4443-8fb0-3acb51b6cab9,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:44.290399 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.290786 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.291150 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.291509 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.291861 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.292216 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.292598 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.292949 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.293299 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.293645 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.293989 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.294331 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98259) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:44.301036 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:44.323250 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:44.323584 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.db.l3_db [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 69fb9ade-9763-4e33-adeb-43b0d95b7bec disassociated (deleted). External IP: 172.27.0.229, port: 5f068024-85aa-46f6-885b-6a3f3be3c00d.
Jun 01 18:59:44.375787 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-35a3d517-6b4d-4291-bbbb-79f8db465da9 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0721800
Jun 01 18:59:44.470179 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-5eba00f0-65de-47d3-8828-2a9b5619a9f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:44.471619 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-5eba00f0-65de-47d3-8828-2a9b5619a9f0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1098 time: 0.0692437
Jun 01 18:59:44.621006 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-7ad335bc-56c9-4478-b44b-53731d5f8351 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:44.622526 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-7ad335bc-56c9-4478-b44b-53731d5f8351 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1259663
Jun 01 18:59:44.785920 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98259) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:59:44.801629 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-0e7e74f7-828f-4b46-a72c-8e7bdad0c4a0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 217 time: 0.1685710
Jun 01 18:59:44.866206 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-304a37e0-6c46-4b16-a6b2-b954b31b8186 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:44.867613 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-304a37e0-6c46-4b16-a6b2-b954b31b8186 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0563264
Jun 01 18:59:44.949186 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-59038185-d24e-469b-b39b-0e20560dc1aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:44.950633 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-59038185-d24e-469b-b39b-0e20560dc1aa service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0727828
Jun 01 18:59:44.963551 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98259) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:59:44.974092 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:59:44.983013 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:59:44.983919 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd735040>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:44.985771 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:45.045078 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-a11734ca-27ee-484e-ba9d-ebb4a649bc2b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "DELETE /v2.0/floatingips/69fb9ade-9763-4e33-adeb-43b0d95b7bec HTTP/1.1" status: 204  len: 168 time: 1.4950943
Jun 01 18:59:45.045798 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d'}] {{(pid=98259) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:59:45.048212 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}735a388270450141da8152ce39f41ae5a9c19cd818bd1af21b688a253f646e0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e323d519-f766-4f7b-976a-2f4f0148dab9" -d '{"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d"}]}' {{(pid=98259) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:59:45.100534 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-f85f340f-b29a-418c-9b17-93b5a3bf45a6 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1386292
Jun 01 18:59:45.169029 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:59:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-744b3c06-c58d-415f-8acc-99da10cd9c19 x-openstack-request-id: req-744b3c06-c58d-415f-8acc-99da10cd9c19 {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:59:45.169750 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d", "status": "completed", "code": 200}]} {{(pid=98259) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:59:45.170312 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-744b3c06-c58d-415f-8acc-99da10cd9c19 {{(pid=98259) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:59:45.170990 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'status': 'completed', 'code': 200}
Jun 01 18:59:45.218157 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:59:45.262956 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-94210809-96e8-4c7c-ada6-a5bdee2b2bab req-1f37f7eb-9eae-4cd0-9b68-351930a97db3 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1521566
Jun 01 18:59:45.443667 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-b70a9222-8f24-4d3f-ad12-17d9c5a7e3cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:45.445182 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-b70a9222-8f24-4d3f-ad12-17d9c5a7e3cf service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 1098 time: 0.1332610
Jun 01 18:59:45.456585 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f2e973-8fe9-4e68-a43a-b27ec790c6b4 req-4c4e4113-4b85-4265-b471-a56c984e041b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:45.457938 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e9f2e973-8fe9-4e68-a43a-b27ec790c6b4 req-4c4e4113-4b85-4265-b471-a56c984e041b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.1109014
Jun 01 18:59:45.563798 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd735040>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:45.567456 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:59:45.575832 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:59:45.577040 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cd735040>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:17Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:45.592350 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e9f2e973-8fe9-4e68-a43a-b27ec790c6b4 req-0813b70f-4105-4cf4-9781-e1d48b2b789b tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1162641
Jun 01 18:59:45.624045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-5482f885-e7e9-44fd-bb25-6ec8f73ecf1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:45.625526 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-5482f885-e7e9-44fd-bb25-6ec8f73ecf1e service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1667616
Jun 01 18:59:45.696919 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-fcb97ae0-7229-4a06-87fe-b1791f2580de service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 200  len: 217 time: 0.0638239
Jun 01 18:59:45.751318 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:59:45.761251 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-91a939bb-ae16-4fbc-bce9-30f7924c907e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:45.762689 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-91a939bb-ae16-4fbc-bce9-30f7924c907e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0598104
Jun 01 18:59:45.840433 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-f1410859-2c33-4d3b-8e48-cb2213c804ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:45.841947 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-f1410859-2c33-4d3b-8e48-cb2213c804ca service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0730379
Jun 01 18:59:45.974241 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-1f2efcc9-29cc-409c-9c4c-6dbc13bf9651 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1248498
Jun 01 18:59:46.094100 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cd735040>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:46.097975 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6edc1d7-e3c3-4ed6-8cd4-606bed7c20b1 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_floatingips': [{'id': '995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'floating_ip_address': '172.27.0.188', 'floating_network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'router_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'port_id': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'mac_address': 'fa:16:3e:cf:4c:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92525751-2490-4364-819d-559c8dee67aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T18:55:56Z', 'updated_at': '2021-06-01T18:55:59Z', 'revision_number': 1, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:59:46.104895 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e323d519-f766-4f7b-976a-2f4f0148dab9 req-df180d94-5082-4003-9824-2b1983ebabaf service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238482
Jun 01 18:59:46.304495 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9a2419-3ec6-41db-b7bb-d656e41067a7 None None] New status for floating IP 69fb9ade-9763-4e33-adeb-43b0d95b7bec: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:59:46.746587 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-117d64d9-d21d-4521-a7cb-4973fcd6ed41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:46.784601 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f5d23d-be1a-4c74-8407-3e3ffc6f8bdd req-a20c3398-12f2-4f3b-8626-91f9f921c935 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:46.785287 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-20f5d23d-be1a-4c74-8407-3e3ffc6f8bdd req-a20c3398-12f2-4f3b-8626-91f9f921c935 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98259) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:59:46.800843 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.quota.resource [req-20f5d23d-be1a-4c74-8407-3e3ffc6f8bdd req-a20c3398-12f2-4f3b-8626-91f9f921c935 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98259) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:59:46.802190 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-20f5d23d-be1a-4c74-8407-3e3ffc6f8bdd req-a20c3398-12f2-4f3b-8626-91f9f921c935 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.1026573
Jun 01 18:59:46.845614 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-20f5d23d-be1a-4c74-8407-3e3ffc6f8bdd req-c7fb7106-61fb-40f9-87ec-8882d4ba4354 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378339
Jun 01 18:59:46.886711 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.158636 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-fbbf6470-7fe4-4285-9898-f3e0a370c95a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:47.160051 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-fbbf6470-7fe4-4285-9898-f3e0a370c95a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 945 time: 0.0792081
Jun 01 18:59:47.297380 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port 5f068024-85aa-46f6-885b-6a3f3be3c00d {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:59:47.297718 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.515753 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] For port 5f068024-85aa-46f6-885b-6a3f3be3c00d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5f068024-85aa-46f6-885b-6a3f3be3c00d,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:59:47.516021 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.643574 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for 5f068024-85aa-46f6-885b-6a3f3be3c00d owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:59:47.752548 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.758238 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-0b4a1c03-f0f2-43f5-90d9-a071aac21693 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:47.805959 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=5f068024-85aa-46f6-885b-6a3f3be3c00d,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:47.839525 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.839907 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.840290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.840684 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.841049 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.841417 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.841812 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.842179 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.842543 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.842902 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.843261 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.843617 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98258) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 18:59:47.849967 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.851860 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:47.894149 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] No DVR routers for this DVR port 5f068024-85aa-46f6-885b-6a3f3be3c00d on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:59:47.896723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:47.899518 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'name': 'network-vif-deleted', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:59:47.902086 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0c2aca1a-125f-4cb8-bb3b-afe8db4ce763" -d '{"events": [{"server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "name": "network-vif-deleted", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:59:47.915047 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-e6a13bdb-1d04-45ce-b7bc-2aeeb7c70b01 req-f47a4f25-97af-4f34-92a6-fdf00c7fac39 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "DELETE /v2.0/ports/5f068024-85aa-46f6-885b-6a3f3be3c00d HTTP/1.1" status: 204  len: 173 time: 0.7471087
Jun 01 18:59:48.009956 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:59:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-144c5d1d-297e-4f78-9426-95dd1ef70b80 x-openstack-request-id: req-144c5d1d-297e-4f78-9426-95dd1ef70b80 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:59:48.010300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "067776cd-3d87-41ad-b327-a700f2bf45f2", "name": "network-vif-deleted", "tag": "5f068024-85aa-46f6-885b-6a3f3be3c00d", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:59:48.010596 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-144c5d1d-297e-4f78-9426-95dd1ef70b80 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:59:48.011028 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '067776cd-3d87-41ad-b327-a700f2bf45f2', 'name': 'network-vif-deleted', 'tag': '5f068024-85aa-46f6-885b-6a3f3be3c00d', 'status': 'completed', 'code': 200}
Jun 01 18:59:48.019993 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-50ccd47c-c9e9-4c32-8fd1-1480dec0e99c req-2453c8e8-7bd5-428a-a444-62392d22eb61 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:59:48.034872 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-50ccd47c-c9e9-4c32-8fd1-1480dec0e99c req-2453c8e8-7bd5-428a-a444-62392d22eb61 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:59:48.036086 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-50ccd47c-c9e9-4c32-8fd1-1480dec0e99c req-2453c8e8-7bd5-428a-a444-62392d22eb61 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=067776cd-3d87-41ad-b327-a700f2bf45f2 HTTP/1.1" status: 200  len: 210 time: 0.0634029
Jun 01 18:59:49.561355 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:50.223946 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5f068024-85aa-46f6-885b-6a3f3be3c00d no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:59:50.257415 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: 5f068024-85aa-46f6-885b-6a3f3be3c00d {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:59:50.257764 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device 5f068024-85aa-46f6-885b-6a3f3be3c00d not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:59:51.517131 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42758) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:59:51.772534 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port a1b5fb53-d2a3-45d1-82e0-292955093602 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:59:51.772886 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:51.889751 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:51.890075 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:52.008779 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for a1b5fb53-d2a3-45d1-82e0-292955093602 owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:59:52.124212 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:52.128469 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-51c89fa9-8361-4880-b957-3aecd09266e2 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:52.175656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=a1b5fb53-d2a3-45d1-82e0-292955093602,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:52.202405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:52.266961 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:52.267423 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.db.l3_db [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Floating IP 995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba disassociated (deleted). External IP: 172.27.0.188, port: ef46ff60-b962-43c5-bb89-c3d73b4dd406.
Jun 01 18:59:52.705263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 18:59:52.883136 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 18:59:52.892227 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 18:59:52.901550 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:59:52.902162 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc59cd0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:52.903652 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:52.961633 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-276a86f8-1337-44fe-a47a-6d614b7641fc tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "DELETE /v2.0/floatingips/995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba HTTP/1.1" status: 204  len: 168 time: 1.4432819
Jun 01 18:59:52.962124 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:59:52.964406 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-666330a2-404a-4b51-97cf-5427d6c4669b" -d '{"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:59:53.014564 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 18:59:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e08287af-91e9-47b2-9a19-7179b3658091 x-openstack-request-id: req-e08287af-91e9-47b2-9a19-7179b3658091 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:59:53.014901 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:59:53.015194 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-e08287af-91e9-47b2-9a19-7179b3658091 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:59:53.015630 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'status': 'completed', 'code': 200}
Jun 01 18:59:53.083749 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:59:53.126719 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666330a2-404a-4b51-97cf-5427d6c4669b req-b4a3ab44-2f08-4193-afbf-9f8f88fb7dcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:53.128770 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-b4a3ab44-2f08-4193-afbf-9f8f88fb7dcd service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=52dbd90f0982402bb02a793614e0020d&device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 1099 time: 0.0722480
Jun 01 18:59:53.272397 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666330a2-404a-4b51-97cf-5427d6c4669b req-6a826c3d-3b3f-44b7-a8d0-3c38a037ff07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:53.273815 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-6a826c3d-3b3f-44b7-a8d0-3c38a037ff07 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 200  len: 912 time: 0.1355791
Jun 01 18:59:53.344609 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-7cc3818b-a4f1-4432-9252-832b745f73a1 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 200  len: 217 time: 0.0636904
Jun 01 18:59:53.352608 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edeeb18-09be-4e72-bf8c-3082545f79fd req-ac390d9c-212a-483b-a1e4-877b8b30efac tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98259) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:53.354072 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3edeeb18-09be-4e72-bf8c-3082545f79fd req-ac390d9c-212a-483b-a1e4-877b8b30efac tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.0827923
Jun 01 18:59:53.402233 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-3edeeb18-09be-4e72-bf8c-3082545f79fd req-f7887e6f-0099-4c7c-acb9-4776bef66553 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421658
Jun 01 18:59:53.409820 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666330a2-404a-4b51-97cf-5427d6c4669b req-83ef94e7-13cb-4ae4-a7dc-2ca08ae371a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:53.411603 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-83ef94e7-13cb-4ae4-a7dc-2ca08ae371a3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 200  len: 851 time: 0.0600834
Jun 01 18:59:53.451370 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc59cd0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:53.455189 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 18:59:53.463546 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 18:59:53.464147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc59cd0>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:53.486951 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666330a2-404a-4b51-97cf-5427d6c4669b req-456aa3c9-cc6b-4fcc-b6c0-80829d8d5839 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:53.488411 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-456aa3c9-cc6b-4fcc-b6c0-80829d8d5839 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0688694
Jun 01 18:59:53.620860 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-cc72b9f3-e639-47c9-b160-c0ffb301bec5 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1232641
Jun 01 18:59:53.639378 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 18:59:53.752032 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-666330a2-404a-4b51-97cf-5427d6c4669b req-8f5b11a0-817c-4d5a-87ec-da33a2220c41 service neutron] 10.222.0.25 "GET /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1236525
Jun 01 18:59:53.944193 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc59cd0>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 18:59:53.948006 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b5bf59e-ff6c-4f66-ad51-7a57f2f93765 None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T18:52:47Z', 'revision_number': 4, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi', '_interfaces': [{'id': '74a3ceab-5d5d-4905-a7ae-8b84e01c61ef', 'name': '', 'network_id': 'ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'mac_address': 'fa:16:3e:f4:03:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:47Z', 'updated_at': '2021-06-01T18:52:55Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'subnets': [{'id': 'e07cf14f-41ea-4248-9d27-d63b4df58f40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 18:59:54.150266 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e53370f-c246-4b1d-9040-0d2dd7811af8 None None] New status for floating IP 995de13c-9c9e-4dd1-b0f2-c5b8f1f587ba: DOWN {{(pid=98261) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 18:59:54.591180 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a21c69-37dd-4135-89e2-4f231b1820d4 req-d0cc0c28-04c4-4f9e-92b1-e1862d2c0155 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:54.592415 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-55a21c69-37dd-4135-89e2-4f231b1820d4 req-d0cc0c28-04c4-4f9e-92b1-e1862d2c0155 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Synchronizing usage tracker for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 18:59:54.606849 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.quota.resource [req-55a21c69-37dd-4135-89e2-4f231b1820d4 req-d0cc0c28-04c4-4f9e-92b1-e1862d2c0155 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Unset dirty status for tenant:52dbd90f0982402bb02a793614e0020d on resource:port {{(pid=98258) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 18:59:54.608007 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-55a21c69-37dd-4135-89e2-4f231b1820d4 req-d0cc0c28-04c4-4f9e-92b1-e1862d2c0155 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.1010859
Jun 01 18:59:54.651455 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-55a21c69-37dd-4135-89e2-4f231b1820d4 req-f01c0cad-f7a3-4437-883a-a1f422dc366d tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/security-groups?id=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0374548
Jun 01 18:59:54.980855 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-783f8a3b-9eb6-4637-b910-684bb94cb677 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98258) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 18:59:54.982277 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-783f8a3b-9eb6-4637-b910-684bb94cb677 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 946 time: 0.0811377
Jun 01 18:59:55.113676 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port ef46ff60-b962-43c5-bb89-c3d73b4dd406 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:59:55.114021 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:55.338280 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] For port ef46ff60-b962-43c5-bb89-c3d73b4dd406, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=ef46ff60-b962-43c5-bb89-c3d73b4dd406,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 18:59:55.338532 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:55.460221 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for ef46ff60-b962-43c5-bb89-c3d73b4dd406 owned by compute:nova {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:59:55.571025 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:55.577600 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:55.649721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=ef46ff60-b962-43c5-bb89-c3d73b4dd406,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:55.652520 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:55.699505 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] No DVR routers for this DVR port ef46ff60-b962-43c5-bb89-c3d73b4dd406 on host hv-cinder-79402 {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 18:59:55.701991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for port, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:55.704754 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'name': 'network-vif-deleted', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406'}] {{(pid=98258) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 18:59:55.706991 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.22/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0269a772698f8a9c49cfc5e6c9f89397f5ed936a81a1dc6fff3be1512679ce9a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9722a9a-b580-42e5-9efc-65164e256efc" -d '{"events": [{"server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "name": "network-vif-deleted", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406"}]}' {{(pid=98258) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 18:59:55.720279 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [req-db553e89-2cc2-4482-8b3f-cb77abac8757 req-8e0cb5e2-ad8b-4802-890b-ac2ecf9b6e6a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.25 "DELETE /v2.0/ports/ef46ff60-b962-43c5-bb89-c3d73b4dd406 HTTP/1.1" status: 204  len: 173 time: 0.7299466
Jun 01 18:59:55.760045 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 18:59:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71904622-5fcf-4d8e-aa79-c64d2e5d7472 x-openstack-request-id: req-71904622-5fcf-4d8e-aa79-c64d2e5d7472 {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 18:59:55.760379 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "92525751-2490-4364-819d-559c8dee67aa", "name": "network-vif-deleted", "tag": "ef46ff60-b962-43c5-bb89-c3d73b4dd406", "status": "completed", "code": 200}]} {{(pid=98258) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 18:59:55.760698 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.22/compute/v2.1/os-server-external-events used request id req-71904622-5fcf-4d8e-aa79-c64d2e5d7472 {{(pid=98258) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 18:59:55.761145 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '92525751-2490-4364-819d-559c8dee67aa', 'name': 'network-vif-deleted', 'tag': 'ef46ff60-b962-43c5-bb89-c3d73b4dd406', 'status': 'completed', 'code': 200}
Jun 01 18:59:55.799425 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [req-892ada3b-ef4f-4814-9a2f-36bf06f82114 req-70712e5c-f6a1-4423-a71a-c30a15146733 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "GET /v2.0/ports?device_id=92525751-2490-4364-819d-559c8dee67aa HTTP/1.1" status: 200  len: 210 time: 0.0423708
Jun 01 18:59:56.213359 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 18:59:57.038901 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42774) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:59:57.252670 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Deleting port 523fbb39-b0e1-48a0-a920-3dc5de62ab10 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 18:59:57.253012 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.367143 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.367368 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.489693 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Calling delete_port for 523fbb39-b0e1-48a0-a920-3dc5de62ab10 owned by network:floatingip {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 18:59:57.595200 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.599412 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-05fb5c8c-bb9d-41e5-a5f7-1b1198d85e15 tempest-VolumesNegativeTest-358851206 tempest-VolumesNegativeTest-358851206-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:57.668776 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'Port': ['ID=523fbb39-b0e1-48a0-a920-3dc5de62ab10,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:57.675584 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:57.735671 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for floatingip, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.750063 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-432175'] for floatingip, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:57.751229 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "DELETE /v2.0/floatingips/22d10692-4f6e-4d14-afbc-e04c94671322 HTTP/1.1" status: 204  len: 168 time: 0.7113557
Jun 01 18:59:58.286205 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ef46ff60-b962-43c5-bb89-c3d73b4dd406 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 18:59:58.320667 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] No Port match for: ef46ff60-b962-43c5-bb89-c3d73b4dd406 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 18:59:58.321020 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Device ef46ff60-b962-43c5-bb89-c3d73b4dd406 not bound to the agent host hv-cinder-79402 {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 18:59:59.119985 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [-] (98259) accepted ('10.222.0.22', 42786) {{(pid=98259) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 18:59:59.187379 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, before_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:59.215879 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:59.282665 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:59.287433 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-c395a219-bf38-4bd4-9114-76ead3982508 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 18:59:59.301706 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=79b7f04f-c3ff-42d0-82b2-2e6dd86603f0,revision_number=None']} {{(pid=98259) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 18:59:59.304931 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG oslo_concurrency.lockutils [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 18:59:59.312749 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron_lib.callbacks.manager [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Notify callbacks [] for security_group, before_response {{(pid=98259) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 18:59:59.313873 dv-cinder-794021-1-iscsi neutron-server[98259]: INFO neutron.wsgi [None req-9f1af8a0-8ca6-43b7-89cc-1c57a22bbcb6 tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] 10.222.0.22 "DELETE /v2.0/security-groups/79b7f04f-c3ff-42d0-82b2-2e6dd86603f0 HTTP/1.1" status: 204  len: 168 time: 0.1929073
Jun 01 18:59:59.365265 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42790) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:00.092300 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:00.502723 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Deleting port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:00.503405 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:00.622347 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] For port 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:00.622703 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:00.750840 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Calling delete_port for 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef owned by network:router_interface {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:00.892491 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:00.896867 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d987d7e9-8a27-4ba2-bcfa-23a08811d29a tempest-TestVolumeBootPattern-640201514 tempest-TestVolumeBootPattern-640201514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:00.942669 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Pushing event deleted for resources: {'Port': ['ID=74a3ceab-5d5d-4905-a7ae-8b84e01c61ef,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:00.969375 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:01.304783 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:01.652078 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Router a26976ef-153b-4903-83a2-c9b55440675d has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 19:00:01.827842 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 19:00:01.836277 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Sync routers for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 19:00:01.839693 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] 10.222.0.22 "PUT /v2.0/routers/a26976ef-153b-4903-83a2-c9b55440675d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4738002
Jun 01 19:00:01.842154 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42794) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:01.848949 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 19:00:01.849562 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ccd4d430>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:02.013792 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks [] for router, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:02.021924 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: dv-cinder-794021-1-iscsi {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 19:00:02.185709 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:02.258548 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Deleting port adca3220-1c19-45f0-9af4-d77ccd7b7837 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:02.258897 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:02.303208 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ccd4d430>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89'}], 'enable_snat': True}, 'gw_port_id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T19:00:00Z', 'revision_number': 5, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port': {'id': 'adca3220-1c19-45f0-9af4-d77ccd7b7837', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:9a:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:44Z', 'updated_at': '2021-06-01T18:52:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:02.306871 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Checking router: a26976ef-153b-4903-83a2-c9b55440675d for host: dv-cinder-794021-1-iscsi {{(pid=98260) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 19:00:02.316673 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Routers {'a26976ef-153b-4903-83a2-c9b55440675d'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98260) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 19:00:02.317288 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3ccd4d430>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a26976ef-153b-4903-83a2-c9b55440675d'], 'active': True} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:02.380930 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] For port adca3220-1c19-45f0-9af4-d77ccd7b7837, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=adca3220-1c19-45f0-9af4-d77ccd7b7837,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:02.381270 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:02.504017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Calling delete_port for adca3220-1c19-45f0-9af4-d77ccd7b7837 owned by network:router_gateway {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:02.507880 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvr_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] Set router a26976ef-153b-4903-83a2-c9b55440675d gateway port host: None {{(pid=98260) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 19:00:02.613386 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_hamode_db [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3ccd4d430>, [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T19:00:02Z', 'revision_number': 6, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98260) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:02.617566 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f9c5aaa-fe70-4db7-8257-f3aebaf1d30f None None] The sync data for ids ['a26976ef-153b-4903-83a2-c9b55440675d'] in dv-cinder-794021-1-iscsi is: [{'id': 'a26976ef-153b-4903-83a2-c9b55440675d', 'name': 'tempest-TestVolumeBootPattern-1326277738-router', 'tenant_id': '52dbd90f0982402bb02a793614e0020d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:43Z', 'updated_at': '2021-06-01T19:00:02Z', 'revision_number': 6, 'project_id': '52dbd90f0982402bb02a793614e0020d', 'gw_port_host': None}] {{(pid=98260) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 19:00:02.752988 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:02.756700 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-95f1658d-d5c8-4b88-b50f-f568c3ed9779 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:02.799975 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Pushing event deleted for resources: {'Port': ['ID=adca3220-1c19-45f0-9af4-d77ccd7b7837,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:02.802410 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:02.891384 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.063090 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.065256 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.087017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.087582 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Fanout notify agent at l3_agent the message router_deleted on router a26976ef-153b-4903-83a2-c9b55440675d {{(pid=98258) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 19:00:03.099775 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.100905 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-00a18c9e-009e-46b8-b027-683bdbdd902c admin admin] 10.222.0.22 "DELETE /v2.0/routers/a26976ef-153b-4903-83a2-c9b55440675d HTTP/1.1" status: 204  len: 168 time: 1.2578640
Jun 01 19:00:03.103426 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42796) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:03.162832 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Deleting subnet e07cf14f-41ea-4248-9d27-d63b4df58f40 {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 19:00:03.165656 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.213441 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.288184 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.539167 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.542899 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:03.580793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e07cf14f-41ea-4248-9d27-d63b4df58f40,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:03.583641 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:03.584674 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.593992 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-c58c3f79-af02-4890-a0b8-9ae4066af2d0 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/e07cf14f-41ea-4248-9d27-d63b4df58f40 HTTP/1.1" status: 204  len: 168 time: 0.4895568
Jun 01 19:00:03.595626 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30855466-b5ea-4832-b8a5-308af51ff10f None None] Network ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 19:00:03.596294 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42798) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:03.695639 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.774735 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Deleting port 2711b045-b658-4c01-b674-0abe449642e9 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:03.775277 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.847615 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] DHCP port deletion for ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 19:00:03.874298 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] For port 2711b045-b658-4c01-b674-0abe449642e9, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=2711b045-b658-4c01-b674-0abe449642e9,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:03.874651 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.911304 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Deleting port 2711b045-b658-4c01-b674-0abe449642e9 {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:03.911682 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:03.995382 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Calling delete_port for 2711b045-b658-4c01-b674-0abe449642e9 owned by network:dhcp {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:04.006865 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] For port 2711b045-b658-4c01-b674-0abe449642e9, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=2711b045-b658-4c01-b674-0abe449642e9,segment=NetworkSegment(6bac363e-177f-4762-a171-bdf73801a782),segment_id=6bac363e-177f-4762-a171-bdf73801a782)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:04.007267 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.041065 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.045929 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-5667c78a-626c-4b61-8070-93353ea0640e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:04.089700 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] No DVR routers for this DVR port 2711b045-b658-4c01-b674-0abe449642e9 on host dv-cinder-794021-1-iscsi {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 19:00:04.132160 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Calling delete_port for 2711b045-b658-4c01-b674-0abe449642e9 owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:04.175918 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.179641 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:04.218279 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Pushing event deleted for resources: {'Port': ['ID=2711b045-b658-4c01-b674-0abe449642e9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:04.220903 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:04.226407 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Pushing event deleted for resources: {'Port': ['ID=2711b045-b658-4c01-b674-0abe449642e9,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:04.230995 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] No DVR routers for this DVR port 2711b045-b658-4c01-b674-0abe449642e9 on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 19:00:04.237109 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.237461 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.237835 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.238123 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.238459 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.238783 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.239106 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.239429 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.240258 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.240258 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.240696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.240696 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-1-iscsi {{(pid=98260) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 19:00:04.243417 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-9cad8373-723a-4580-8e45-5fb04850b854 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:04.313239 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.325963 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cc320e50>,) {'filters': {'network_id': ['ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:04.338095 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc320e50>, '6bac363e-177f-4762-a171-bdf73801a782') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:04.338385 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cc320e50>, '6bac363e-177f-4762-a171-bdf73801a782') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:04.349416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.366057 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.372786 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Releasing vlan 81 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 19:00:04.373163 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 19:00:04.386519 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 19:00:04.454124 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device adca3220-1c19-45f0-9af4-d77ccd7b7837 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:04.463571 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.467546 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:04.483267 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:04.488934 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: adca3220-1c19-45f0-9af4-d77ccd7b7837 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:04.489243 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Pushing event deleted for resources: {'Network': ['ID=ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:04.489360 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device adca3220-1c19-45f0-9af4-d77ccd7b7837 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:04.489686 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:04.493704 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:04.509226 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4d144c8b-d99a-4d98-a2cc-1cf59876c83b admin admin] 10.222.0.22 "DELETE /v2.0/networks/ef6e0a64-47e1-4e4b-9bf8-a28f00dcff27 HTTP/1.1" status: 204  len: 168 time: 0.9093077
Jun 01 19:00:04.509390 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42800) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:04.522575 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:04.522927 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 74a3ceab-5d5d-4905-a7ae-8b84e01c61ef not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:04.523342 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 2711b045-b658-4c01-b674-0abe449642e9 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:04.557982 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 2711b045-b658-4c01-b674-0abe449642e9 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:04.558327 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 2711b045-b658-4c01-b674-0abe449642e9 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:05.028908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1617111'] for router_interface, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:05.418096 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Deleting port d9cd041c-0b7f-4f38-9724-e313d6652e1f {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:05.418442 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:05.536072 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] For port d9cd041c-0b7f-4f38-9724-e313d6652e1f, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=d9cd041c-0b7f-4f38-9724-e313d6652e1f,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:05.536449 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:05.763628 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Calling delete_port for d9cd041c-0b7f-4f38-9724-e313d6652e1f owned by network:router_interface {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:05.914501 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:05.919080 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-146d9f97-7176-4888-bcd0-3a73d30240d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:05.965801 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Pushing event deleted for resources: {'Port': ['ID=d9cd041c-0b7f-4f38-9724-e313d6652e1f,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:05.968816 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:06.239350 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1630248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1617479'] for router_interface, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:06.604436 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Router a0288693-400a-40e4-ba75-80b31d2b44a2 has already been hosted by L3 agent a781c47f-234c-4b81-beaa-1c11a964613c {{(pid=98258) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 19:00:06.778062 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] Notify agent at l3_agent.dv-cinder-794021-1-iscsi the message routers_updated {{(pid=98258) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 19:00:06.786164 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Sync routers for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 19:00:06.793553 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4f47f093-f413-46f2-bd3d-882afe8ac01b admin admin] 10.222.0.22 "PUT /v2.0/routers/a0288693-400a-40e4-ba75-80b31d2b44a2/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.2831604
Jun 01 19:00:06.796315 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 19:00:06.796482 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42802) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:06.796943 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d520>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:06.968642 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: dv-cinder-794021-1-iscsi {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 19:00:06.969320 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks [] for router, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:07.244589 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:07.280918 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d520>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'external_fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T19:00:05Z', 'revision_number': 5, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port': {'id': '7bc20b13-4eab-4d52-8b6f-71b0a631c9d9', 'name': '', 'network_id': '51c15cd0-3fb9-458f-96e0-aa926a3585bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:fe:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T18:52:51Z', 'updated_at': '2021-06-01T18:52:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c252d780-bee9-4a2c-a569-c3a5207a21ad', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-1-iscsi'}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:07.284648 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Checking router: a0288693-400a-40e4-ba75-80b31d2b44a2 for host: dv-cinder-794021-1-iscsi {{(pid=98261) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 19:00:07.292739 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Routers {'a0288693-400a-40e4-ba75-80b31d2b44a2'} bound to L3 agent in host dv-cinder-794021-1-iscsi {{(pid=98261) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 19:00:07.293327 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d520>, 'dv-cinder-794021-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T18:39:47Z,description=<?>,heartbeat_timestamp=2021-06-01T18:59:47Z,host='dv-cinder-794021-1-iscsi',id=a781c47f-234c-4b81-beaa-1c11a964613c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T18:39:47Z,topic='l3_agent')) {'router_ids': ['a0288693-400a-40e4-ba75-80b31d2b44a2'], 'active': True} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:07.314064 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Deleting port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:07.314412 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:07.434348 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] For port 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,segment=NetworkSegment(8cb30134-8767-4a68-8c75-632abd865f06),segment_id=8cb30134-8767-4a68-8c75-632abd865f06)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:07.434708 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:07.438179 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_dvr_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] Set router a0288693-400a-40e4-ba75-80b31d2b44a2 gateway port host: None {{(pid=98261) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 19:00:07.540615 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.l3_hamode_db [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7ff3cdc7d520>, [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T19:00:07Z', 'revision_number': 6, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port_host': None}], 'dv-cinder-794021-1-iscsi', False) {} {{(pid=98261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:07.544272 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ac1d768-86b9-4da6-a9e1-a0bbd9ecf6dd None None] The sync data for ids ['a0288693-400a-40e4-ba75-80b31d2b44a2'] in dv-cinder-794021-1-iscsi is: [{'id': 'a0288693-400a-40e4-ba75-80b31d2b44a2', 'name': 'tempest-TestVolumeBootPattern-2135850102-router', 'tenant_id': 'c475e7accec74e35aa5db988675335f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T18:52:50Z', 'updated_at': '2021-06-01T19:00:07Z', 'revision_number': 6, 'project_id': 'c475e7accec74e35aa5db988675335f7', 'gw_port_host': None}] {{(pid=98261) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 19:00:07.556674 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Calling delete_port for 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 owned by network:router_gateway {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:07.691698 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:07.695297 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-df1ff5bf-9d89-4796-b4e2-e96c29b173c1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:07.736881 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Pushing event deleted for resources: {'Port': ['ID=7bc20b13-4eab-4d52-8b6f-71b0a631c9d9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:07.739910 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:07.830132 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1617340'] for router_gateway, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.002252 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2041834', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14940'] for router, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.004416 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.026784 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-2046042'] for router, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.027292 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a0288693-400a-40e4-ba75-80b31d2b44a2 {{(pid=98258) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 19:00:08.039000 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] Notify callbacks [] for router, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.040124 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-2db1bf86-23b9-41d7-8ee8-4ac03d7e6c17 admin admin] 10.222.0.22 "DELETE /v2.0/routers/a0288693-400a-40e4-ba75-80b31d2b44a2 HTTP/1.1" status: 204  len: 168 time: 1.2427776
Jun 01 19:00:08.042551 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42804) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:08.099793 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Deleting subnet 722f743e-d63c-4f10-98d2-3f241dd732a9 {{(pid=98258) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 19:00:08.102519 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.156554 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1433009'] for subnet, precommit_delete_associations {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.230475 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1009452'] for subnet, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.466191 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d9cd041c-0b7f-4f38-9724-e313d6652e1f no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:08.503086 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: d9cd041c-0b7f-4f38-9724-e313d6652e1f {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:08.503457 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device d9cd041c-0b7f-4f38-9724-e313d6652e1f not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:08.503867 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:08.539643 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:08.539995 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 7bc20b13-4eab-4d52-8b6f-71b0a631c9d9 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:08.585343 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1009623', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80480', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1394222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2101645'] for subnet, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.589721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-60dc7bb7-41fd-42d5-bc97-87aca86459dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:08.622361 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=722f743e-d63c-4f10-98d2-3f241dd732a9,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:08.625288 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:08.626255 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for subnet, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.631051 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84f3a81f-82da-4248-93a9-799c80d19528 None None] Network 8dd511ae-bf28-4636-8cd2-85c0262c3d2c requested from dv-cinder-794021-1-iscsi {{(pid=98260) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 19:00:08.631896 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-e6450627-53b8-4dd1-b10c-d8ace55723c5 admin admin] 10.222.0.22 "DELETE /v2.0/subnets/722f743e-d63c-4f10-98d2-3f241dd732a9 HTTP/1.1" status: 204  len: 168 time: 0.5884194
Jun 01 19:00:08.634308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42806) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:08.744143 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-999805'] for network, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.816325 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Deleting port 85c283ff-38a4-426c-894b-2f2880e61d95 {{(pid=98258) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:08.816630 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.879887 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] DHCP port deletion for 8dd511ae-bf28-4636-8cd2-85c0262c3d2c request from dv-cinder-794021-1-iscsi {{(pid=98260) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 19:00:08.917019 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.db [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] For port 85c283ff-38a4-426c-894b-2f2880e61d95, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=85c283ff-38a4-426c-894b-2f2880e61d95,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98258) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:08.917383 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:08.942697 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Deleting port 85c283ff-38a4-426c-894b-2f2880e61d95 {{(pid=98260) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 19:00:08.943071 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792820748081'] for port, before_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.040147 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.db [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] For port 85c283ff-38a4-426c-894b-2f2880e61d95, host dv-cinder-794021-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-1-iscsi',level=0,port_id=85c283ff-38a4-426c-894b-2f2880e61d95,segment=NetworkSegment(836c080f-db4c-41d0-b7f7-5f5e5accb310),segment_id=836c080f-db4c-41d0-b7f7-5f5e5accb310)] {{(pid=98260) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 19:00:09.040585 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1613528'] for port, precommit_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.042572 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.plugin [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Calling delete_port for 85c283ff-38a4-426c-894b-2f2880e61d95 owned by network:dhcp {{(pid=98258) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:09.088498 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1393649'] for port, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.093521 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-f128e5fb-b493-4ead-a7cd-b0649344b191 tempest-VolumesSnapshotTestJSON-611020205 tempest-VolumesSnapshotTestJSON-611020205-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:09.136860 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Pushing event deleted for resources: {'Port': ['ID=85c283ff-38a4-426c-894b-2f2880e61d95,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:09.138573 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.db.l3_dvrscheduler_db [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] No DVR routers for this DVR port 85c283ff-38a4-426c-894b-2f2880e61d95 on host dv-cinder-794021-1-iscsi {{(pid=98258) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 19:00:09.140616 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:09.199560 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Calling delete_port for 85c283ff-38a4-426c-894b-2f2880e61d95 owned by network:dhcp {{(pid=98260) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 19:00:09.240061 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1034746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-80461', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1628626', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792820752523', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792820220874'] for port, after_delete {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.243494 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:09.253908 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1014203', 'neutron.services.segments.db._delete_segments_for_network-8792820669516'] for network, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.266588 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7ff3cd61feb0>,) {'filters': {'network_id': ['8dd511ae-bf28-4636-8cd2-85c0262c3d2c']}} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:09.279422 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd61feb0>, '836c080f-db4c-41d0-b7f7-5f5e5accb310') {'for_net_delete': True} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:09.279717 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.services.segments.db [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7ff3cd61feb0>, '836c080f-db4c-41d0-b7f7-5f5e5accb310') {} {{(pid=98258) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 19:00:09.285866 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Pushing event deleted for resources: {'Port': ['ID=85c283ff-38a4-426c-894b-2f2880e61d95,revision_number=None']} {{(pid=98260) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:09.289189 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG oslo_concurrency.lockutils [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:09.291706 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d915a6e0-8441-42c2-87c1-e6ac504e6058 None None] No DVR routers for this DVR port 85c283ff-38a4-426c-894b-2f2880e61d95 on host dv-cinder-794021-1-iscsi {{(pid=98260) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 19:00:09.293608 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792820671335', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1432998'] for segment, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.310818 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553'] for segment, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.317635 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Releasing vlan 79 on physical network physnet1 to pool {{(pid=98258) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 19:00:09.318017 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1014553', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1393548'] for segment, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]: Traceback (most recent call last):
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     timer()
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     cb(*args, **kw)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     return func(*args, **kwargs)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     self._notify()
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     self.callback(batched_events)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     event.method(event)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     return f(self, *a, **k)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._get(url).json()
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     return self.request(url, 'GET', **kwargs)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 19:00:09.331852 dv-cinder-794021-1-iscsi neutron-server[98258]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 19:00:09.408655 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1014178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1641695', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1628635', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1617367'] for network, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.412304 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-a49b9b0e-2a20-4df4-815c-b0fbbb977e74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:09.425542 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1628608'] for network, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.435308 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Pushing event deleted for resources: {'Network': ['ID=8dd511ae-bf28-4636-8cd2-85c0262c3d2c,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:09.439906 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:09.443237 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-707e726d-a5c0-41bf-b4c0-f8b6d2fd0f1d admin admin] 10.222.0.22 "DELETE /v2.0/networks/8dd511ae-bf28-4636-8cd2-85c0262c3d2c HTTP/1.1" status: 204  len: 168 time: 0.8080270
Jun 01 19:00:09.556399 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42810) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:09.603481 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-4136a14d-fd22-48d8-a08c-69e3f98767d9 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=52dbd90f0982402bb02a793614e0020d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0458512
Jun 01 19:00:09.605695 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42812) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:09.664721 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.690342 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.740290 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.743859 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3fe13f55-55c0-4372-94a0-5bee046ee289 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:09.758185 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ad9614d-4a54-4842-a9a0-54b0ebcb0042,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:09.761985 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:09.765230 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:09.766354 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-3afb65ba-aa56-45b2-9f82-e55f9f0c647f admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/6ad9614d-4a54-4842-a9a0-54b0ebcb0042 HTTP/1.1" status: 204  len: 168 time: 0.1597807
Jun 01 19:00:10.091753 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42818) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:10.138734 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-259fae7d-1ad0-41f9-a799-ac0583d8a747 admin admin] 10.222.0.22 "GET /v2.0/security-groups?tenant_id=c475e7accec74e35aa5db988675335f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0457742
Jun 01 19:00:10.140911 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [-] (98258) accepted ('10.222.0.22', 42820) {{(pid=98258) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 19:00:10.197176 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:10.221865 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:10.274453 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1640523'] for security_group, after_delete {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:10.279942 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-ad91ddd3-d28f-4de7-91b5-6491052b99eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 19:00:10.291833 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18448c5e-d2b1-40d1-94cd-4262cb1bf7b8,revision_number=None']} {{(pid=98258) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 19:00:10.294704 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG oslo_concurrency.lockutils [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 19:00:10.297263 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron_lib.callbacks.manager [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98258) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:10.298500 dv-cinder-794021-1-iscsi neutron-server[98258]: INFO neutron.wsgi [None req-d9c8cb69-2628-42de-9d94-6fa347d700e7 admin admin] 10.222.0.22 "DELETE /v2.0/security-groups/18448c5e-d2b1-40d1-94cd-4262cb1bf7b8 HTTP/1.1" status: 204  len: 168 time: 0.1566474
Jun 01 19:00:10.455686 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 85c283ff-38a4-426c-894b-2f2880e61d95 no longer exists at agent ovs-agent-dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 19:00:10.491376 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.plugin [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] No Port match for: 85c283ff-38a4-426c-894b-2f2880e61d95 {{(pid=98260) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 19:00:10.491727 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron.plugins.ml2.rpc [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Device 85c283ff-38a4-426c-894b-2f2880e61d95 not bound to the agent host dv-cinder-794021-1-iscsi {{(pid=98260) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 19:00:10.883206 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:14.163315 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4a67b9bc-0900-4612-9533-c656f9a0bcd5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:16.752217 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-716d78ee-09af-4da9-b62b-ae6822e8cf86 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:16.887836 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:17.849531 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:19.564373 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:33.212159 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:00:40.891179 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:44.167666 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-cc3a1835-fdb6-4476-9bad-7e8b06b3fcc9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:46.746188 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-29365045-65da-4537-aadb-cf8ade16b5b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:46.888239 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:47.851830 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:00:49.566731 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:10.211304 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:01:10.905912 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:14.170098 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-76028545-aad8-43be-90eb-86cf21ee465d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:16.747537 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5350931f-e7a5-4662-9cb8-055931fc3f5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:16.890084 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:17.854962 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:19.569145 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:40.922046 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:44.171125 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-0a5f63e5-0f9e-47a0-a8c1-03733f69cb60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:46.749422 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-57faaa42-3e49-4210-a8f6-bb730b57c4d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:46.890083 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:47.209932 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:01:47.858352 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:01:49.571681 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:10.920598 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:14.171895 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-650af5cf-3a9c-4baf-8e54-5ae19dd43340 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:16.751031 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-b1639ac6-47f9-4cd3-b1ca-74f8485a8ca3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:16.890433 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:17.860571 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:19.575129 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:24.208830 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:02:40.935276 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:44.173026 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-a0a15c25-0acc-4e40-a04f-50735e82da49 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:46.758951 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-64684974-3f00-44b1-afdd-7bdbe8b79253 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:46.891037 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:47.863878 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:49.578648 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:02:59.739696 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [req-a8966588-283f-4af8-bad8-723876420f68 req-dda69c4f-5d6c-4674-b19c-f4b830db6981 service neutron] (98258) timed out ('10.222.0.25', 53737) {{(pid=98258) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 19:02:59.802590 dv-cinder-794021-1-iscsi neutron-server[98258]: DEBUG neutron.wsgi [req-1c640dd6-2116-431f-abf8-04e1e96b6768 req-06cd9ab9-0dbc-42b9-ae7c-2e665ff884be service neutron] (98258) timed out ('10.222.0.25', 53764) {{(pid=98258) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 19:03:01.207721 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:03:03.020133 dv-cinder-794021-1-iscsi neutron-server[98259]: DEBUG neutron.wsgi [req-d374c307-0780-4b0e-b8bd-e1a44f12057f req-53071d2a-a764-420a-992e-ff2c7b48f66b service neutron] (98259) timed out ('10.222.0.25', 53785) {{(pid=98259) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 19:03:10.933453 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:14.173545 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-0aca0c80-2de6-43a8-8f1f-be24e6a83129 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:16.750572 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-8cc11cbf-aebd-479a-a0aa-73dde7d0e29a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:16.891618 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:17.866653 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:19.580490 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:38.207009 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:03:40.935844 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:44.174235 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-67d897e9-a471-4434-b2c1-03b3476136b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:46.752320 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-3c811215-d8cd-4536-afb3-3d021998d78b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:46.896681 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:47.869341 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:03:49.582255 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:10.948077 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:14.175816 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-5eec55a8-2810-48cb-a487-31c257527681 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:15.205253 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:04:16.754817 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-39aed4cb-e7ac-4385-9532-947ece49cf70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:16.897971 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:17.872242 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:19.585400 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:40.963665 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:44.176314 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-f2a0c478-9382-452a-ab7b-d77c09f19ad8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:46.757233 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7841cf98-af8c-4e89-9d8c-e2c0deeca178 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:46.898508 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:47.874834 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-4c31b3f6-529e-4544-8b58-ec2be2188123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:49.587972 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-9d5add0e-ce87-46be-886c-6fd2269ff86a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:04:52.204594 dv-cinder-794021-1-iscsi neutron-server[98261]: DEBUG neutron.db.agents_db [None req-61580eee-2919-4846-8fd7-cb69c1c943bd None None] Agent healthcheck: found 6 active agents {{(pid=98261) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 19:05:10.962576 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-ceb2b3f8-da70-46c0-9396-c3d02035d5f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:05:14.177976 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-6ff95537-3372-4d69-b9c9-74dc19ca4dae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:05:16.759512 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-6d7f3a95-d740-4c82-8ccb-d860c90c5457 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 19:05:16.900980 dv-cinder-794021-1-iscsi neutron-server[98260]: DEBUG neutron_lib.callbacks.manager [None req-7c6101ed-7b91-4781-8623-0113d8597974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792820705904', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1012235'] for agent, after_update {{(pid=98260) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}